-- Logs begin at Mon 2022-08-29 19:25:30 UTC, end at Mon 2022-08-29 20:31:30 UTC. -- Aug 29 20:04:04.274264 dv-cinder-854261-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 20:04:04.283620 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:04:04 2022] *** Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: nodename: dv-cinder-854261-2-iscsi Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: machine: x86_64 Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: clock source: unix Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: pcre jit disabled Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: detected number of CPU cores: 4 Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: current working directory: / Aug 29 20:04:04.285634 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:04:04.286354 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: your processes number limit is 47680 Aug 29 20:04:04.286354 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: your memory page size is 4096 bytes Aug 29 20:04:04.286354 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: detected max file descriptor number: 2048 Aug 29 20:04:04.286354 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: lock engine: pthread robust mutexes Aug 29 20:04:04.286354 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: thunder lock: enabled Aug 29 20:04:04.286354 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 20:04:04.286354 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:04:04.324900 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: Python main interpreter initialized at 0x55f8cca439c0 Aug 29 20:04:04.324900 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: python threads support enabled Aug 29 20:04:04.324900 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: your server socket listen backlog is limited to 100 connections Aug 29 20:04:04.324900 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:04:04.325241 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:04:04.325313 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: *** Operational MODE: preforking *** Aug 29 20:04:04.325565 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:04:04.325565 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: spawned uWSGI master process (pid: 105759) Aug 29 20:04:04.325772 dv-cinder-854261-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 20:04:04.327099 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: spawned uWSGI worker 1 (pid: 105760, cores: 1) Aug 29 20:04:04.327099 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: spawned uWSGI worker 2 (pid: 105761, cores: 1) Aug 29 20:04:04.327099 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:04:04.985796 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:04:04.991813 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:04:06.083326 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:04:06.083326 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: from cryptography.utils import int_from_bytes Aug 29 20:04:06.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:04:06.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: from cryptography.utils import int_from_bytes Aug 29 20:04:06.084315 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:04:06.084315 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: from cryptography.utils import int_from_bytes Aug 29 20:04:06.084431 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:04:06.084431 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: from cryptography.utils import int_from_bytes Aug 29 20:04:08.603677 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:04:08.604222 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:04:08.604448 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:04:08.604628 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:04:08.604979 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:04:08.605068 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:04:08.605148 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:04:08.605406 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:04:08.605511 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.605770 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.605876 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:04:08.606061 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:04:08.606156 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.606409 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.606516 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.606744 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.606844 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.607055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.607149 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.607378 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.607470 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.607698 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.607781 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.608014 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.608099 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.608278 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.608368 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.608595 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.608690 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.608923 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854261-2-iscsi {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.609008 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.609213 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.609295 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.609531 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.609626 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.609870 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.609955 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854261-2-iscsi {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.610198 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.610282 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.610505 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.610600 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.610819 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.610904 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.611125 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.611210 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.611438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.611634 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.611763 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.612793 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.612931 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.612931 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.613170 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.613313 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.613444 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.613561 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.613682 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.613853 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.613985 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.614113 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.614231 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.614358 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.614469 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.614602 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.614723 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.614842 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.614969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.615090 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.615209 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.615329 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854261-2-iscsi {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.615458 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.615579 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.615698 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.615864 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.616037 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854261-2-iscsi {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.616169 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.616977 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.617159 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.617255 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.617475 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.617602 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.617891 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.618054 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.618220 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.618372 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.618552 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.618688 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.618868 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.619016 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.619202 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.619346 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.619530 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.619659 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.619847 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.619998 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.620177 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.620334 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.620477 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.620623 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.620769 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.620934 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.621074 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.621241 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.621384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.621554 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.621699 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.621890 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.622032 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.622215 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.622370 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.622514 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.622649 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.622824 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.622966 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.623101 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.623325 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.623464 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.623664 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.623810 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.623947 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.623947 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.624222 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.624359 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.624494 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.624640 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.624775 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.624932 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.625070 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.625205 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.625340 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.625493 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.625642 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.625834 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.625985 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.626128 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.626264 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.626399 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.626547 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.626694 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.626828 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.626986 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.627129 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.627265 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.627408 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.627551 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.627687 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.627822 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.627958 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.628093 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.628235 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.628406 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.628558 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.628731 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.628879 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.629025 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.629168 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.629352 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.629494 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.629773 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.629931 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.630082 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.630226 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.630362 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.630506 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.630652 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.630788 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.630970 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.631113 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.631283 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.631426 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.631608 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.631748 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.631943 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.632120 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.632258 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.632393 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.632603 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.632755 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.632912 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.633062 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.633198 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.633334 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.633469 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.633613 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.633816 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.633960 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.634096 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.634230 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.634411 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.634578 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.634756 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.634898 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.635068 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.635218 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.635361 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.635510 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.635667 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.635808 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.635975 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.636117 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.636276 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.636431 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.636577 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.636712 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.636876 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.637031 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.637176 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.637311 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.637475 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.637618 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.637806 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.637950 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.638114 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.638257 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.638424 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.638577 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.638719 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.638856 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.639028 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.639182 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.639354 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.639497 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.639679 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.639822 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.639969 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.640119 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.640288 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.640429 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.640577 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.640712 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.640887 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.641039 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.641195 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.641335 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.641505 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.641649 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.641842 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.641979 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.642145 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.642537 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.642702 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.642891 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.643041 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.643177 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.643312 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.643456 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.643600 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.643736 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.643879 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.644015 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.644205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.644347 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.644508 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.644665 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.644803 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.644937 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.645107 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.645249 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.645415 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.645571 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.645740 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.645884 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.646034 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.646181 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.646322 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.646466 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.646612 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.646748 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.646916 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.647065 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.647224 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.647375 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.648113 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.648340 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.648508 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.648647 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.648808 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.648946 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.649117 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.649267 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.649405 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.649546 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.649691 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.649862 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.650016 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.650153 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.650289 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:04:08.650473 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.650736 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.650878 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.651013 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.651170 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.651314 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.651457 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.651594 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.651728 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.651885 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.652029 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.652223 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.652373 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.652553 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.652696 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.652869 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.653012 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.653187 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.653339 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.653520 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.653663 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.653863 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.654000 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.654167 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.654324 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.654468 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.654603 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.654793 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.654946 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.655119 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.655271 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.655455 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.655605 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.655766 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.655907 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.656081 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.656231 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.656387 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.656524 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.656703 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.656846 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.657056 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.657222 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.657392 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.657543 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.657732 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.657881 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.658030 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.658167 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.658382 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.658525 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.658706 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.658847 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.659022 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.659166 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.659319 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.659457 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.659636 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.659785 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.659959 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.660108 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.660274 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.660425 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.660588 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.660741 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.660910 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.661052 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.661243 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.661385 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.661562 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.661741 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.661886 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.662021 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.662204 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.662349 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.662524 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.662677 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.662839 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.662982 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.663225 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.663380 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.663593 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.664274 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.664462 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.664603 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.664824 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.664972 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.665110 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.665257 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.665393 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.665534 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.665700 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.665889 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.666051 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.666193 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.666329 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.666473 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.666640 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.666785 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.666939 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.667081 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.667242 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.667384 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.667551 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.667693 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.667845 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.667998 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.668134 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.668268 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.668443 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.668586 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.668756 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.668902 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.669063 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.669206 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.669384 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.669540 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.669677 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.669840 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.670033 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.670186 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.670330 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.670478 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.670647 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.670791 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.670957 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.671102 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.671268 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.671418 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.671581 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.671722 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.671869 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.672004 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.672187 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.672369 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.672512 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.672647 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.672803 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.672946 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.673130 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.673272 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.673439 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.673581 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.673757 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.673909 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.674125 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.674264 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.674401 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.674534 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.674670 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.674805 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.674971 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.675115 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.675284 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.675435 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.675578 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.675713 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.675897 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.676049 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.676211 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.676355 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.676540 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.676697 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.676855 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.676998 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.677165 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.677307 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.677493 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.677645 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.677833 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.677970 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.678141 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.678284 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.678430 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.678574 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.678766 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.678913 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.679057 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.679194 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.679370 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.679527 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.679664 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.679810 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.679954 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.680090 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.680260 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.680404 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.680565 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.680719 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.680857 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.680992 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.681161 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.681305 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.681478 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.681620 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.681818 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.681959 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.682111 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.682248 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.682383 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.682519 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.682704 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.682847 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.683014 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.683158 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.683320 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.683471 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.683610 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.683764 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.683909 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.684046 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.684250 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.684393 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.684556 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.684708 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.684903 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.685046 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.685242 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.685393 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.685567 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.685749 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.685913 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.686049 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.686223 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.686369 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.686540 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.686693 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.686843 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.686978 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.687153 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.687296 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.687470 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.687629 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.687767 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.687917 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.688091 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.688233 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.688407 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.688556 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.688722 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.688864 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.689035 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.689176 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.689325 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.689461 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.689645 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.689864 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.690003 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.690137 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.690283 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.690420 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.690603 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.690755 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.690949 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.691093 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.691259 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.691402 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.691579 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.691721 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.691893 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.692049 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.692208 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.692349 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.692525 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.692666 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.692838 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.692989 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.693151 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.693291 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.693461 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.693608 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.693797 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.693968 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.694120 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.694262 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.694495 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.694652 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.694794 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.694946 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.695089 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.695232 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.695381 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.695524 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.695695 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.695854 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.696008 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.696151 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.696295 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.696464 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.696627 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.696771 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.696914 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.697162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.697319 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.697471 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.697623 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.697806 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.697972 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.698152 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.698300 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.698442 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.698597 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.698740 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.698889 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.699031 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.699180 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.699324 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.699485 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.699628 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.699770 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.699922 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.700071 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.700222 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.700367 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.700508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.700658 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.700799 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.700942 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.701092 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.701235 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.701377 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.701519 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.701668 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.701848 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.702004 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.702155 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.702304 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.702448 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.702617 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.702767 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.702981 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.703133 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.703275 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.703415 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.703558 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.703710 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.703864 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.704006 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.704147 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.704288 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.704455 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.704613 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.704779 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.704924 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.705066 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.705207 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.705348 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.705497 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.705647 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.705853 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.706009 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.706159 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.706308 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.706461 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.706603 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.706747 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.706895 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.707037 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.707210 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.707362 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.707505 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.707653 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.707806 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.707958 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.708109 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.708253 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.708428 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.708577 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.708741 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.708891 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.709044 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.709194 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.709336 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.709484 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.709636 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.709811 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.710543 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.710744 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.710894 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.711157 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.711312 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.711466 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.711610 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.711760 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.711906 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.712049 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.712198 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.712365 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.712509 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.712651 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.712793 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.712935 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.713078 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.713235 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.713390 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.713577 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.713821 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.714164 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.714312 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.714489 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.714651 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.714815 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.714962 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.715139 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.715297 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.715464 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.715612 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.715811 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.715971 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.716125 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.716281 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.716450 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.716609 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.716765 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.716908 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.717050 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.717199 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.717342 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.717484 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.717639 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.717825 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.717972 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.718113 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.718297 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.718456 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.718614 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.718755 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.718898 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.719040 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.719182 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.719338 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.719487 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.719631 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.719773 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.719916 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.720058 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.720209 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.720354 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.720506 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.720671 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.720821 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.720964 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.721115 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.721281 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.721429 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.721572 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.721747 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.721910 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.722059 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.722238 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.722399 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.722554 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.722695 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.722846 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.722990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.723134 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.723276 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.723426 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.723575 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.723767 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.723916 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.724059 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.724211 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.724403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.724556 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.724738 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.724895 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.725039 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.725194 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.725344 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.725495 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.725761 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.726493 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.726640 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.726783 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.726926 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.727093 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.727239 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.727380 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.727523 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.727666 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.727809 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.728025 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.728179 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.728321 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.728463 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.728605 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.728748 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.728902 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.729066 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.729210 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.729353 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.729494 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.729650 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.729846 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.729991 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.730133 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.730275 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.730417 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.730572 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.730715 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.730868 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.731017 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.731160 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.731302 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.731453 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.731595 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.731737 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.731879 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.732022 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.732199 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.732355 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.732498 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.732646 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.732804 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.732955 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.733111 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.733254 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.733396 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.733538 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.733686 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.733881 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.734048 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.734192 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.734342 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.734486 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.734627 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.734783 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.734934 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.735085 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.735228 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.735369 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.735511 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.735653 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.735803 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.735947 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.736089 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.736238 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.736388 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.736540 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.736693 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.736835 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.736976 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.737126 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.737277 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.737428 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.737572 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.737764 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.737914 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.738057 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.738200 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.738358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.738501 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.738654 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.738804 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.738960 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.739106 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.739258 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.739400 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.739549 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.739692 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.739835 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.739985 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.740128 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.740270 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.740422 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.740564 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.740706 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.740881 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.740981 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.741067 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.741148 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.741411 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.741504 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.741852 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.741970 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.742166 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.742265 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.742478 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.742671 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.742873 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.743021 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.743170 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.743311 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.743455 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.743605 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.743749 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.743891 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.744057 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.744214 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.744358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.744521 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.744671 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.744821 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.744970 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.745115 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.745264 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.745414 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.745558 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.745737 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.745889 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.746031 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.746174 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.746327 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.746493 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.746636 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.746777 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.746919 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.747077 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.747221 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.747386 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.747537 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.747679 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.747820 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.748005 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.748154 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.748320 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.748480 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.748624 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.748766 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.748949 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.749129 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.749280 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.749422 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.749571 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.749748 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.749909 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.750059 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.750212 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.750372 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.750515 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.750664 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.750847 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.750994 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.751144 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.751287 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.751429 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.751584 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.751728 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.751877 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.752020 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.752161 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.752319 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.752471 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.752615 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.752757 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.752898 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.753041 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.753213 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.753373 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.753528 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.753671 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.753880 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.754026 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.754175 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.754336 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.754480 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.754622 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.754765 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.754909 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.755060 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.755203 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.755345 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.755494 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.755637 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.755779 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.755997 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.756143 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.756295 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.756438 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.756655 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.756826 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.757018 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.757170 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.757338 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.757534 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.757759 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.757926 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.758071 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.758222 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.758383 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.758532 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.758681 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.758832 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.758999 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.759150 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.759294 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.759442 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.759717 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.759884 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.760028 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.760178 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.760339 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.760498 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.760642 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.760792 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.760936 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.761078 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.761228 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.761371 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.761514 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.761669 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.761862 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.762022 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.762166 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.762317 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.762478 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.762622 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.762764 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.762913 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.763079 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.763235 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.763389 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.763532 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.763699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.763848 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.764122 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.764271 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.764427 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.764581 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.764724 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.764865 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.765145 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.765303 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.765449 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.765591 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.765846 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.765996 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.766149 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.766321 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.766474 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.766636 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.766863 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.767009 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.767152 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.767547 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.767689 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.767840 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.767990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.768133 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.768282 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.768431 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.768576 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.768726 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.768888 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.769031 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.769173 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.769323 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.769467 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.769619 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.769794 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.769945 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.770099 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.770254 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.770408 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.770561 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.770722 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.770884 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.771091 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.771241 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.771421 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.771572 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.771738 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.771889 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.772064 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.772214 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.772398 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.773100 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.773333 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.773495 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.773716 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.773870 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.774027 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.774171 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.774342 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.774492 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.774657 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.774817 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.774990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.775140 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.775282 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.775424 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.775604 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.775763 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.775909 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.776051 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.776221 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.776378 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.776528 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.776680 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.776824 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.776968 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.777138 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.777287 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.777450 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.777619 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.777785 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.777944 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.778112 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.778262 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.778441 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.778602 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.778767 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.778915 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.779058 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.779201 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.779389 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.779539 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.779693 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.779834 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.779977 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.780120 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.780275 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.780419 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.780584 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.780734 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.780931 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.781084 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.781236 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.781388 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.781542 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.781684 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.781887 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.782031 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.782222 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.782371 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.782537 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.782692 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.782872 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.783030 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.783198 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.783354 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.783521 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.783682 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.783825 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.783975 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.784150 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.784304 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.784454 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.784595 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.784738 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.784888 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.785031 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.785174 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.785340 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.785489 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.785653 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.785826 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.785985 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.786138 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.786288 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.786434 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.786585 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.786728 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.786871 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.787013 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.787155 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.787297 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.787449 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.787601 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.787744 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.787887 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.788069 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.788765 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.788926 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.789076 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.789221 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.789386 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.789544 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.789697 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.789889 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.790043 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.790197 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.790365 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.790517 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.790767 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.790924 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.791067 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.791225 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.791403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.791553 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.791728 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.791879 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.792047 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.792205 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.792354 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.792504 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.792661 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.792805 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.792981 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.793131 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.793299 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.793455 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.793606 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.793773 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.793946 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.794094 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.794247 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.794400 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.794550 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.794693 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.794870 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.795021 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.795191 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.795390 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.795718 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.795869 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.796033 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.796181 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.796338 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.796491 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.796636 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.796779 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.796953 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.797103 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.797318 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.797463 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.797607 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.797795 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.797946 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.798088 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.798243 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.798397 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.798541 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.798684 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.798827 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.798969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.799124 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.799273 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.799441 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.799592 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.799770 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.799933 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.800086 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.800239 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.800383 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.800526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.800702 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.800975 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.801126 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.801313 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.801463 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.801636 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.801827 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.802008 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.802168 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.802315 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.802457 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.802634 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.802792 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.802935 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.803087 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.803234 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.803376 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.803547 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.803730 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.803909 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.804069 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.804254 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.804425 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.804582 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.804733 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.804901 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.805046 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.805195 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.805339 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.805494 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.805638 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.805841 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.805986 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.806139 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.806282 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.806437 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.806580 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.806722 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.806872 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.807015 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.807169 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.807313 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.807455 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.807699 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.807847 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.808000 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.808155 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.808437 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.808586 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.808769 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.808919 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.809099 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.809256 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.809402 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.809551 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.809739 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.809894 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.810073 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.810233 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.810377 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.810520 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.810695 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.810844 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.810997 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.811148 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.811292 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.811434 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.811584 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.811727 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.811878 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.812031 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.812185 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.812334 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.812478 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.812621 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.812776 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.812920 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.813062 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.813206 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.813488 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.813647 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.813827 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.813967 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.814290 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.814394 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.814622 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.814756 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.814949 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.815058 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.815267 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.815366 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.815577 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.815674 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.815943 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.816077 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.816341 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.816455 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.816643 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.816763 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.816976 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.817066 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.817274 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.817361 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.817583 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.817671 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.817915 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.818017 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.818230 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.818325 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.818540 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.818634 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.818845 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.818939 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.819155 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.819241 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.819487 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.819581 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.819800 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.819890 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.820105 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.820193 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.820415 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.820502 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.820722 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.820808 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.821027 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.821127 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.821332 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.821417 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.821637 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.821750 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.821971 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.822073 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.822285 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.822371 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.822600 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.822686 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.822906 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.823005 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.823220 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.823307 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.823531 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.823711 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.823861 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.824015 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.824162 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.824305 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.824457 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.824608 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.824759 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.824903 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.825053 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.825197 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.825376 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.825538 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.825691 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.825862 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.826005 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.826148 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.826316 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.826476 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.826701 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.826847 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.827119 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.827281 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.827425 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.827575 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.827731 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.827881 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.828025 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.828168 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.828321 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.828473 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.828628 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.828771 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.829023 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.829174 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.829366 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.829525 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.829849 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.830006 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.830006 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.830288 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.830442 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.830595 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.830749 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.830898 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.831041 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.831190 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.831333 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.831486 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.831629 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.831778 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.831921 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.832064 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.832253 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.832407 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.832552 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.832705 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.832847 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.832997 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.833148 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.833291 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.833434 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.833584 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.833755 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.833905 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.834092 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.834237 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.834379 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.834538 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.834683 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.834838 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.835500 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.835675 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.835884 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.836038 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.836182 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.836334 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.836478 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.836619 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.836769 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.836928 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.837090 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.837347 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.837500 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.837644 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.837839 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.837984 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.838144 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.838289 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.838443 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.838585 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.838734 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.838878 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.839041 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.839212 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.839360 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.839508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.839652 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.839798 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.839953 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.840097 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.840246 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.840397 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.840541 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.840692 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.840870 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.841061 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.841214 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.841364 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.841507 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.841658 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.841823 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.841980 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.842124 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.842266 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.842415 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.842568 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.842769 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.842927 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.843077 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.843220 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.843372 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.843515 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.843665 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.843815 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.843976 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.844127 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.844280 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.844424 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.844568 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.844720 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.844876 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.845021 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.845174 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.845318 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.845468 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.845611 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.845797 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.845957 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.846112 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.846256 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.846406 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.846548 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.846711 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.846862 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.847005 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.847149 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.847394 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.847557 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.847708 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.847869 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.848024 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.848169 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.848326 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.848478 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.848632 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.848784 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.848928 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.849076 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.849259 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.849409 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.849558 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.849727 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.849877 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.850031 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.850175 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.850326 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.850478 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.851257 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.851416 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.851416 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.851818 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.851965 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.852119 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.852264 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.852408 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.852551 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.852703 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.852873 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.853035 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.853186 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.853341 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.853485 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.853627 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.853627 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.853993 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.854154 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.854298 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.854298 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.854571 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.854726 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.854871 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.855014 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.855163 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.855316 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.855459 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.855615 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.855759 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.855901 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.856043 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.856185 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.856388 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.856623 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.856771 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.856921 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.857064 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.857249 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.857556 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.857800 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.857959 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.858103 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.858256 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.858407 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.858563 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.858708 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.858849 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.858999 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.859143 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.859285 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.859447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.859597 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.859743 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.859885 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.860028 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.860170 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.860325 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.860469 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.860611 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.860760 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.860904 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.861056 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.861210 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.861353 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.861502 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.861645 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.861818 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.861975 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.862119 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.862268 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.862412 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.862555 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.862697 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.862852 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.862996 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.863149 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.863291 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.863440 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.863595 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.863739 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.863881 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.864024 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.864166 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.864317 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.864469 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.864612 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.864754 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.864906 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.865056 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.865199 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.865355 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.865499 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.865641 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.865834 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.865978 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.866134 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.866309 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.866586 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.866792 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.866954 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.867098 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.867253 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.867253 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.867639 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.867789 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.867931 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.867931 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.868214 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.868358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.868509 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.868653 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.868795 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.868956 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:04:08.869100 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.869243 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:04:08.869384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:04:09.023714 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO dbcounter [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Registered counter for database nova_api Aug 29 20:04:09.024203 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO dbcounter [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Registered counter for database nova_api Aug 29 20:04:09.044175 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_db.sqlalchemy.engines [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:04:09.047134 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_db.sqlalchemy.engines [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:04:09.051015 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writer thread running {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:04:09.053996 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writer thread running {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:04:09.108613 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.context [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87b86c2a-8fe9-4ea5-824e-801d166189f2(cell1) {{(pid=105761) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:04:09.112438 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:04:09.112771 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.context [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87b86c2a-8fe9-4ea5-824e-801d166189f2(cell1) {{(pid=105760) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:04:09.112910 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:04:09.114518 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:04:09.115243 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:04:09.115688 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:04:09.116727 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:04:09.117209 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:04:09.117769 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:04:09.118829 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:04:09.119574 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:04:09.119722 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO dbcounter [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Registered counter for database nova_cell0 Aug 29 20:04:09.120022 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:04:09.122047 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:04:09.123739 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO dbcounter [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Registered counter for database nova_cell1 Aug 29 20:04:09.124018 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO dbcounter [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Registered counter for database nova_cell0 Aug 29 20:04:09.128029 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO dbcounter [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Registered counter for database nova_cell1 Aug 29 20:04:09.130914 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_db.sqlalchemy.engines [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:04:09.134127 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_db.sqlalchemy.engines [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:04:09.135983 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_db.sqlalchemy.engines [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:04:09.140068 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writer thread running {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:04:09.140512 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writer thread running {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:04:09.141139 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_db.sqlalchemy.engines [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:04:09.145806 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writer thread running {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:04:09.286421 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writer thread running {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:04:09.290695 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO dbcounter [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Registered counter for database nova_cell0 Aug 29 20:04:09.295391 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO dbcounter [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Registered counter for database nova_cell0 Aug 29 20:04:09.297818 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_db.sqlalchemy.engines [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:04:09.302248 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writer thread running {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:04:09.304182 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG oslo_db.sqlalchemy.engines [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:04:09.308910 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writer thread running {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:04:09.648982 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: WARNING keystonemiddleware.auth_token [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:04:09.649939 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: WARNING keystonemiddleware.auth_token [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:04:09.656304 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: WARNING keystonemiddleware.auth_token [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:04:09.657108 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: WARNING keystonemiddleware.auth_token [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:04:10.002918 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: WARNING keystonemiddleware.auth_token [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:04:10.007706 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: WARNING keystonemiddleware.auth_token [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:04:10.008859 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: WARNING keystonemiddleware.auth_token [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:04:10.013642 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: WARNING keystonemiddleware.auth_token [None req-b69276d5-7db8-4e84-928c-f47db6c40860 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:04:10.014156 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8cca439c0 pid: 105761 (default app) Aug 29 20:04:10.016220 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:04:10.017699 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Aug 29 20:04:10.018138 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Mon Aug 29 20:04:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:04:10.019243 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8cca439c0 pid: 105760 (default app) Aug 29 20:05:32.291629 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:32.292646 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 29 20:05:32.293050 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:32.306627 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:SELECT=3 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:32.307996 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_cell0:SELECT=3 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:32.308892 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_cell1:SELECT=3 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:32.310191 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:33.216477 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-774bd567-8cbe-4423-85b9-6e05596dfeff admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:33.253212 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-774bd567-8cbe-4423-85b9-6e05596dfeff admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.953012 Aug 29 20:05:33.253978 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1292 bytes} [Mon Aug 29 20:05:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:05:35.676345 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:35.677317 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-7fab823d-82be-49c5-9e9c-c9021e09dbad None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Aug 29 20:05:35.689416 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 3/4] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:36.145304 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-46df0d1a-f723-41df-b693-1d1e343e2b07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:36.192355 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-46df0d1a-f723-41df-b693-1d1e343e2b07 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.507686 Aug 29 20:05:36.193810 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 2/5] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:05:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:05:36.423668 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-c7f5689c-698c-4d57-b76a-1245df0b0399 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:36.444038 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_api:SELECT=3 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:36.444602 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_cell1:SELECT=3 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:36.445298 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_cell0:SELECT=3 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:36.446490 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:36.501404 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-c7f5689c-698c-4d57-b76a-1245df0b0399 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299379 Aug 29 20:05:36.502025 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 4/6] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 29 20:05:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:05:38.893457 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-46df0d1a-f723-41df-b693-1d1e343e2b07 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:38.894856 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-46df0d1a-f723-41df-b693-1d1e343e2b07 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001832 Aug 29 20:05:38.895298 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 3/7] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:39.573359 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-9c73f705-da59-4b9a-8bff-b058f3d348c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "vcpus": 1}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:39.615165 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-9c73f705-da59-4b9a-8bff-b058f3d348c5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712829 Aug 29 20:05:39.617738 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 5/8] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:05:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:05:39.628607 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-85389813-3e40-456e-a77c-8dfaf62ad2d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:39.668579 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-85389813-3e40-456e-a77c-8dfaf62ad2d3 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043836 Aug 29 20:05:39.677579 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 4/9] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 29 20:05:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:05:42.027264 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-9c73f705-da59-4b9a-8bff-b058f3d348c5 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:42.028312 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-9c73f705-da59-4b9a-8bff-b058f3d348c5 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 29 20:05:42.028794 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:42.447421 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-ea638835-e845-4d6d-96fc-685b892d2c82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "vcpus": 1}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:42.464908 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-ea638835-e845-4d6d-96fc-685b892d2c82 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430108 Aug 29 20:05:42.465451 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 5/11] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:05:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:05:42.477695 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-cbc34416-1413-40f9-982c-9b3d7ab8dcf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:42.501407 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-cbc34416-1413-40f9-982c-9b3d7ab8dcf8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027617 Aug 29 20:05:42.502026 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 7/12] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 29 20:05:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:05:44.897531 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-ea638835-e845-4d6d-96fc-685b892d2c82 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:44.899189 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-ea638835-e845-4d6d-96fc-685b892d2c82 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006563 Aug 29 20:05:44.899815 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 6/13] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:45.367674 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-c754fac9-aad4-4fb5-8d81-53b1f6e6669f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:45.387027 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-c754fac9-aad4-4fb5-8d81-53b1f6e6669f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479890 Aug 29 20:05:45.387779 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 8/14] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:05:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:05:45.400601 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-fa38ca7a-2413-4dd6-bf3c-b9c0ae2816ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:45.423774 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-fa38ca7a-2413-4dd6-bf3c-b9c0ae2816ad admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026921 Aug 29 20:05:45.424336 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 7/15] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 29 20:05:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:05:47.774381 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-c754fac9-aad4-4fb5-8d81-53b1f6e6669f admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:47.775278 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-c754fac9-aad4-4fb5-8d81-53b1f6e6669f admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 29 20:05:47.775975 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 9/16] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:48.224039 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-bf5f8122-2226-4672-a61b-db5db9b3a0c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:48.244495 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-bf5f8122-2226-4672-a61b-db5db9b3a0c0 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462250 Aug 29 20:05:48.245869 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 8/17] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:05:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:05:48.260856 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-05686fad-159c-4c63-b4bd-0bbfc7bd939c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:48.286931 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-05686fad-159c-4c63-b4bd-0bbfc7bd939c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032768 Aug 29 20:05:48.288258 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 10/18] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 29 20:05:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:05:50.732366 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-bf5f8122-2226-4672-a61b-db5db9b3a0c0 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:50.733353 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-bf5f8122-2226-4672-a61b-db5db9b3a0c0 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Aug 29 20:05:50.733811 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 9/19] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:51.147968 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-3c26e44b-5ee7-4977-87fa-905ca72e41da admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:51.172821 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-3c26e44b-5ee7-4977-87fa-905ca72e41da admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.430599 Aug 29 20:05:51.173358 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 11/20] 10.222.0.73 () {60 vars in 1292 bytes} [Mon Aug 29 20:05:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:05:53.648713 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-bf5f8122-2226-4672-a61b-db5db9b3a0c0 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:53.650082 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-bf5f8122-2226-4672-a61b-db5db9b3a0c0 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Aug 29 20:05:53.650618 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 10/21] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:54.070651 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-b4414cf5-266b-41e2-af69-07eb11ff3a5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:54.090961 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-b4414cf5-266b-41e2-af69-07eb11ff3a5e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.434022 Aug 29 20:05:54.091535 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 12/22] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:05:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:05:54.104623 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-abeca149-ecfb-4e07-b1d9-9ecd225b5fc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:54.130093 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-abeca149-ecfb-4e07-b1d9-9ecd225b5fc5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029194 Aug 29 20:05:54.130661 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 11/23] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 29 20:05:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:05:56.538043 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-b4414cf5-266b-41e2-af69-07eb11ff3a5e admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:56.539062 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-b4414cf5-266b-41e2-af69-07eb11ff3a5e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 29 20:05:56.539457 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 13/24] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:56.943523 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-c86f0d98-75ae-42a7-8263-d02373121ead admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:56.962299 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-c86f0d98-75ae-42a7-8263-d02373121ead admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416220 Aug 29 20:05:56.962855 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 12/25] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:05:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:05:56.975914 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-67c2f137-690d-4be9-a4f7-3e52e8a3004a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:56.999343 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-67c2f137-690d-4be9-a4f7-3e52e8a3004a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028188 Aug 29 20:05:56.999912 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 14/26] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 29 20:05:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:05:59.384798 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-c86f0d98-75ae-42a7-8263-d02373121ead admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:59.385859 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-c86f0d98-75ae-42a7-8263-d02373121ead admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 29 20:05:59.386263 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:59.800361 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-653ad3ba-f7a5-4aa4-a2cc-2e8f153024b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "id": "3", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:59.820625 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-653ad3ba-f7a5-4aa4-a2cc-2e8f153024b8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.425401 Aug 29 20:05:59.821870 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 15/28] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:05:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:05:59.834243 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-500e0bed-60de-4819-a1a1-0161772227d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:05:59.863042 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-500e0bed-60de-4819-a1a1-0161772227d9 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032850 Aug 29 20:05:59.864109 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 14/29] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 29 20:05:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:02.277037 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-653ad3ba-f7a5-4aa4-a2cc-2e8f153024b8 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:02.278084 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-653ad3ba-f7a5-4aa4-a2cc-2e8f153024b8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 29 20:06:02.278493 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:02.739186 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-85b2c8d6-fe61-48da-8c7d-db3f2942350a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:02.745018 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:02.762653 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-85b2c8d6-fe61-48da-8c7d-db3f2942350a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478070 Aug 29 20:06:02.763470 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 15/31] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:06:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:02.775992 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-c0f0d900-bfe0-4734-bbe0-e401264dffa5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:02.801903 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-c0f0d900-bfe0-4734-bbe0-e401264dffa5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029516 Aug 29 20:06:02.802477 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 17/32] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 29 20:06:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:05.187900 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-85b2c8d6-fe61-48da-8c7d-db3f2942350a admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:05.188908 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-85b2c8d6-fe61-48da-8c7d-db3f2942350a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 29 20:06:05.189492 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 16/33] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:05.667958 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-37a355d9-c437-4aca-addc-74c280f24214 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:05.751180 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-37a355d9-c437-4aca-addc-74c280f24214 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.554967 Aug 29 20:06:05.751805 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 18/34] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 29 20:06:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:05.767318 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-31a5c3b9-3cbd-4517-b99a-a68c093ae6af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:05.798696 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-31a5c3b9-3cbd-4517-b99a-a68c093ae6af admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035224 Aug 29 20:06:05.799681 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 17/35] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 29 20:06:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:24.738518 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-37a355d9-c437-4aca-addc-74c280f24214 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:24.739535 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-37a355d9-c437-4aca-addc-74c280f24214 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Aug 29 20:06:24.740104 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 19/36] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:06:24.750694 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:25.147298 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-1cbc853e-2e69-402c-ae0f-01c06c9c00d7 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:25.166876 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-1cbc853e-2e69-402c-ae0f-01c06c9c00d7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.420576 Aug 29 20:06:25.167408 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1292 bytes} [Mon Aug 29 20:06:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:06:26.233304 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-37a355d9-c437-4aca-addc-74c280f24214 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:26.234362 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-37a355d9-c437-4aca-addc-74c280f24214 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 29 20:06:26.234752 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 20/38] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:26.752024 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-e3b3cb1e-bf9c-4bcb-8345-90f1e3476ebd admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:26.757655 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.wsgi [None req-e3b3cb1e-bf9c-4bcb-8345-90f1e3476ebd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-e3b3cb1e-bf9c-4bcb-8345-90f1e3476ebd admin admin] Request method failure captured: Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Accept: application/json Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Accept-Encoding: gzip, deflate Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Connection: keep-alive Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Content-Length: 0 Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Host: 10.222.0.73 Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Openstack-Api-Version: compute 2.90 Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Openstack-System-Scope: None Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: User-Agent: python-novaclient Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Auth-Token: gAAAAABjDRxCVk1WuqSf6nYr_Au-nU90pilqakAXfJsUC7hAlsNcmltP8__sOdajz0__Z8k7GywTEgXofbXXTRxp7DSVke3mRb7h4T0NHMvxXw3QF3GEtBPtTuLUnNL-I4RUIaMFCmKauaIoPUxn0PMEheH2vXcK-StV-73gEXHF48eiAQqTWk0 Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Domain-Id: None Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Domain-Name: None Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Identity-Status: Confirmed Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Is-Admin-Project: True Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Domain-Id: default Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Domain-Name: Default Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Name: admin Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Role: member,admin,reader Aug 29 20:06:26.760872 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Roles: member,admin,reader Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}] Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant: admin Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant-Name: admin Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User: admin Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Domain-Id: default Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Domain-Name: Default Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Id: 7ab6b80a7eaf40e691fcd95e0949b22e Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Name: admin Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: method: > Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: exception: Flavor 42 could not be found. Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: action_args: {'id': '42'} Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:06:26.762447 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:26.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.764699 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-e3b3cb1e-bf9c-4bcb-8345-90f1e3476ebd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:06:26.765966 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-e3b3cb1e-bf9c-4bcb-8345-90f1e3476ebd admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389962 Aug 29 20:06:26.765966 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 19/39] 10.222.0.73 () {60 vars in 1190 bytes} [Mon Aug 29 20:06:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:26.772471 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-ea7e3e50-b67f-4b50-a8f4-aa6479434f52 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:26.776540 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:26.797513 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-ea7e3e50-b67f-4b50-a8f4-aa6479434f52 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028508 Aug 29 20:06:26.798143 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 21/40] 10.222.0.73 () {60 vars in 1210 bytes} [Mon Aug 29 20:06:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:06:26.808006 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-985d539f-e4c9-48c0-aad9-282392938a0a admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:26.830866 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-985d539f-e4c9-48c0-aad9-282392938a0a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026463 Aug 29 20:06:26.831401 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1210 bytes} [Mon Aug 29 20:06:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:06:26.840760 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-7e014ff0-e63b-4510-a258-b432c3134c51 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:26.848054 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.wsgi [None req-7e014ff0-e63b-4510-a258-b432c3134c51 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-7e014ff0-e63b-4510-a258-b432c3134c51 admin admin] Request method failure captured: Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Accept: application/json Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Accept-Encoding: gzip, deflate Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Connection: keep-alive Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Content-Length: 0 Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Host: 10.222.0.73 Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Openstack-Api-Version: compute 2.90 Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Openstack-System-Scope: None Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: User-Agent: python-novaclient Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Auth-Token: gAAAAABjDRxCVk1WuqSf6nYr_Au-nU90pilqakAXfJsUC7hAlsNcmltP8__sOdajz0__Z8k7GywTEgXofbXXTRxp7DSVke3mRb7h4T0NHMvxXw3QF3GEtBPtTuLUnNL-I4RUIaMFCmKauaIoPUxn0PMEheH2vXcK-StV-73gEXHF48eiAQqTWk0 Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Domain-Id: None Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Domain-Name: None Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Identity-Status: Confirmed Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Is-Admin-Project: True Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Domain-Id: default Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Domain-Name: Default Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Name: admin Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Role: member,admin,reader Aug 29 20:06:26.851306 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Roles: member,admin,reader Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}] Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant: admin Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant-Name: admin Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User: admin Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Domain-Id: default Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Domain-Name: Default Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Id: 7ab6b80a7eaf40e691fcd95e0949b22e Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Name: admin Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: method: > Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: exception: Flavor 42 could not be found. Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: action_args: {'id': '42'} Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:06:26.852869 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:26.854055 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:26.855162 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-7e014ff0-e63b-4510-a258-b432c3134c51 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:06:26.856144 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-7e014ff0-e63b-4510-a258-b432c3134c51 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015465 Aug 29 20:06:26.856144 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 22/42] 10.222.0.73 () {60 vars in 1190 bytes} [Mon Aug 29 20:06:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:27.816410 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-985d539f-e4c9-48c0-aad9-282392938a0a admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:27.817432 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-985d539f-e4c9-48c0-aad9-282392938a0a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 29 20:06:27.817879 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 21/43] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:28.347109 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-ad20372c-57ba-428b-b6f9-6d00b408d034 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:28.352477 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.wsgi [None req-ad20372c-57ba-428b-b6f9-6d00b408d034 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-ad20372c-57ba-428b-b6f9-6d00b408d034 admin admin] Request method failure captured: Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Accept: application/json Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Accept-Encoding: gzip, deflate Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Connection: keep-alive Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Content-Length: 0 Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Host: 10.222.0.73 Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Openstack-Api-Version: compute 2.90 Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Openstack-System-Scope: None Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: User-Agent: python-novaclient Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Auth-Token: gAAAAABjDRxDmmvMxVCDzzQkdx4PpPk02448xEQQjX76EHl40rFQlHnfX_CdB377ZngQwoZKmEoEZohktPpSHmnkoh4HgNedbc0R3MbZyAWT6RXBf0QHew55oELeF6xFctKWlg-n8reTJlzbsZD2XBU-H-e0lNLyILacCHzlGPmDH-lLX-e9uoU Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Domain-Id: None Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Domain-Name: None Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Identity-Status: Confirmed Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Is-Admin-Project: True Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Domain-Id: default Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Domain-Name: Default Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Name: admin Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Role: member,admin,reader Aug 29 20:06:28.354035 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Roles: member,admin,reader Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}] Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant: admin Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant-Name: admin Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User: admin Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Domain-Id: default Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Domain-Name: Default Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Id: 7ab6b80a7eaf40e691fcd95e0949b22e Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Name: admin Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: method: > Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: exception: Flavor 84 could not be found. Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: action_args: {'id': '84'} Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:06:28.355533 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:28.356483 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.357784 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-ad20372c-57ba-428b-b6f9-6d00b408d034 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:06:28.359022 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-ad20372c-57ba-428b-b6f9-6d00b408d034 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399151 Aug 29 20:06:28.359022 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 23/44] 10.222.0.73 () {60 vars in 1190 bytes} [Mon Aug 29 20:06:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:28.365113 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-399ffe0f-857d-46e4-ab2f-946267f41cb3 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:28.379997 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-399ffe0f-857d-46e4-ab2f-946267f41cb3 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018392 Aug 29 20:06:28.380516 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1210 bytes} [Mon Aug 29 20:06:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:06:28.389882 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-918aba56-6ee7-481f-bef7-f15e8945d653 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:28.405516 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-918aba56-6ee7-481f-bef7-f15e8945d653 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019092 Aug 29 20:06:28.406074 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1210 bytes} [Mon Aug 29 20:06:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:06:28.416046 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6d0e57b4-321b-4b34-930e-5590261cd4a9 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:28.421505 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.wsgi [None req-6d0e57b4-321b-4b34-930e-5590261cd4a9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6d0e57b4-321b-4b34-930e-5590261cd4a9 admin admin] Request method failure captured: Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Accept: application/json Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Accept-Encoding: gzip, deflate Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Connection: keep-alive Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Content-Length: 0 Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Host: 10.222.0.73 Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Openstack-Api-Version: compute 2.90 Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Openstack-System-Scope: None Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: User-Agent: python-novaclient Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Auth-Token: gAAAAABjDRxDmmvMxVCDzzQkdx4PpPk02448xEQQjX76EHl40rFQlHnfX_CdB377ZngQwoZKmEoEZohktPpSHmnkoh4HgNedbc0R3MbZyAWT6RXBf0QHew55oELeF6xFctKWlg-n8reTJlzbsZD2XBU-H-e0lNLyILacCHzlGPmDH-lLX-e9uoU Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Domain-Id: None Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Domain-Name: None Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Identity-Status: Confirmed Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Is-Admin-Project: True Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Domain-Id: default Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Domain-Name: Default Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Name: admin Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Role: member,admin,reader Aug 29 20:06:28.423087 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Roles: member,admin,reader Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}] Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant: admin Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant-Name: admin Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User: admin Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Domain-Id: default Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Domain-Name: Default Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Id: 7ab6b80a7eaf40e691fcd95e0949b22e Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Name: admin Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: method: > Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: exception: Flavor 84 could not be found. Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: action_args: {'id': '84'} Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:06:28.424615 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:28.425546 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:28.426990 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6d0e57b4-321b-4b34-930e-5590261cd4a9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:06:28.428216 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6d0e57b4-321b-4b34-930e-5590261cd4a9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011957 Aug 29 20:06:28.428216 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1190 bytes} [Mon Aug 29 20:06:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:29.435650 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-918aba56-6ee7-481f-bef7-f15e8945d653 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:29.436685 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-918aba56-6ee7-481f-bef7-f15e8945d653 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 29 20:06:29.437096 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 25/48] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:29.990431 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3c9248b5-b3e8-40cb-b47c-4747902cbafb admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:29.997183 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.wsgi [None req-3c9248b5-b3e8-40cb-b47c-4747902cbafb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3c9248b5-b3e8-40cb-b47c-4747902cbafb admin admin] Request method failure captured: Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Accept: application/json Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Accept-Encoding: gzip, deflate Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Connection: keep-alive Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Content-Length: 0 Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Host: 10.222.0.73 Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Openstack-Api-Version: compute 2.90 Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Openstack-System-Scope: None Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: User-Agent: python-novaclient Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Auth-Token: gAAAAABjDRxFWWc-Jch0NdZMPPprGt6xzYyGU-tkpYOKmREdG6UzKuxwHohHUj4YBa7kx6L3xtOVExUQ51-SFAZ75QMudhUVYrP7Bt9XRyLhLtmVYqsRgb3X12KGTquQelbOzXyW7mWt60zzKSlyLI4v-uv1R8Ws4NUDqCWVAzUM4tYnWxnXzPY Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Domain-Id: None Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Domain-Name: None Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Identity-Status: Confirmed Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Is-Admin-Project: True Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Domain-Id: default Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Domain-Name: Default Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Project-Name: admin Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Role: member,admin,reader Aug 29 20:06:29.998969 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Roles: member,admin,reader Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}] Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant: admin Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-Tenant-Name: admin Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User: admin Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Domain-Id: default Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Domain-Name: Default Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Id: 7ab6b80a7eaf40e691fcd95e0949b22e Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: X-User-Name: admin Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: method: > Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: exception: Flavor 451 could not be found. Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: action_args: {'id': '451'} Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:06:30.001358 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:30.002438 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.003614 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3c9248b5-b3e8-40cb-b47c-4747902cbafb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:06:30.005040 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-3c9248b5-b3e8-40cb-b47c-4747902cbafb admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.418852 Aug 29 20:06:30.005040 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1193 bytes} [Mon Aug 29 20:06:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:30.011626 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-2df50bc3-9d6c-40c4-8c42-5ef28311d990 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:30.028064 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-2df50bc3-9d6c-40c4-8c42-5ef28311d990 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020710 Aug 29 20:06:30.028603 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 26/50] 10.222.0.73 () {60 vars in 1210 bytes} [Mon Aug 29 20:06:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:06:30.038522 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:30.054540 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019857 Aug 29 20:06:30.055073 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 25/51] 10.222.0.73 () {60 vars in 1210 bytes} [Mon Aug 29 20:06:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:06:30.065284 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-85779512-f2c2-4f6b-a6ed-3ce7c7394424 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:30.070724 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.wsgi [None req-85779512-f2c2-4f6b-a6ed-3ce7c7394424 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-85779512-f2c2-4f6b-a6ed-3ce7c7394424 admin admin] Request method failure captured: Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Accept: application/json Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Accept-Encoding: gzip, deflate Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Connection: keep-alive Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Content-Length: 0 Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Host: 10.222.0.73 Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Openstack-Api-Version: compute 2.90 Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Openstack-System-Scope: None Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: User-Agent: python-novaclient Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Auth-Token: gAAAAABjDRxFWWc-Jch0NdZMPPprGt6xzYyGU-tkpYOKmREdG6UzKuxwHohHUj4YBa7kx6L3xtOVExUQ51-SFAZ75QMudhUVYrP7Bt9XRyLhLtmVYqsRgb3X12KGTquQelbOzXyW7mWt60zzKSlyLI4v-uv1R8Ws4NUDqCWVAzUM4tYnWxnXzPY Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Domain-Id: None Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Domain-Name: None Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Identity-Status: Confirmed Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Is-Admin-Project: True Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Domain-Id: default Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Domain-Name: Default Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Project-Name: admin Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Role: member,admin,reader Aug 29 20:06:30.072205 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Roles: member,admin,reader Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee34b4bd3d8043258a1a5d3588fa8f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee34b4bd3d8043258a1a5d3588fa8f9c"}]}] Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant: admin Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant-Id: ee34b4bd3d8043258a1a5d3588fa8f9c Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-Tenant-Name: admin Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User: admin Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Domain-Id: default Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Domain-Name: Default Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Id: 7ab6b80a7eaf40e691fcd95e0949b22e Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: X-User-Name: admin Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: method: > Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: exception: Flavor 451 could not be found. Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: action_args: {'id': '451'} Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:06:30.073526 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:30.074384 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: ERROR nova.api.openstack.wsgi Aug 29 20:06:30.075508 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-85779512-f2c2-4f6b-a6ed-3ce7c7394424 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:06:30.076734 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-85779512-f2c2-4f6b-a6ed-3ce7c7394424 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012367 Aug 29 20:06:30.076734 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 27/52] 10.222.0.73 () {60 vars in 1193 bytes} [Mon Aug 29 20:06:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 20:06:31.050235 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:31.051257 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 29 20:06:31.051652 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:31.633433 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-58fdf76c-be11-4e94-bcb5-a82939fe2eb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:31.655581 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-58fdf76c-be11-4e94-bcb5-a82939fe2eb5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.459304 Aug 29 20:06:31.656146 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 28/54] 10.222.0.73 () {64 vars in 1235 bytes} [Mon Aug 29 20:06:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:32.683077 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:32.684075 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 29 20:06:32.684465 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:33.215652 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-35cb3212-6f7a-473a-bb92-1f6d4a4235d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:33.236631 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-35cb3212-6f7a-473a-bb92-1f6d4a4235d3 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.411125 Aug 29 20:06:33.236631 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 29/56] 10.222.0.73 () {64 vars in 1235 bytes} [Mon Aug 29 20:06:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:06:34.223335 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:34.224330 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 29 20:06:34.224723 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 28/57] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:34.878283 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-1e5d7191-2678-4198-9060-6f77e15f0a5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:34.897669 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-1e5d7191-2678-4198-9060-6f77e15f0a5a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.530987 Aug 29 20:06:34.898226 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 30/58] 10.222.0.73 () {64 vars in 1235 bytes} [Mon Aug 29 20:06:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:35.879113 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:35.880125 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 29 20:06:35.880520 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 29/59] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:36.416623 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-6d26b329-1d40-4b9d-8245-141e58888a23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:36.435650 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-6d26b329-1d40-4b9d-8245-141e58888a23 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.410672 Aug 29 20:06:36.436193 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 31/60] 10.222.0.73 () {64 vars in 1235 bytes} [Mon Aug 29 20:06:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:37.413166 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:37.414198 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 20:06:37.414592 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 30/61] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:37.942941 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-8141fd6c-eb87-4a6e-a6b9-cc9e26a09194 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:37.963902 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-8141fd6c-eb87-4a6e-a6b9-cc9e26a09194 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.411671 Aug 29 20:06:37.964369 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 32/62] 10.222.0.73 () {60 vars in 1202 bytes} [Mon Aug 29 20:06:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:07:31.548850 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:31.550042 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-affc28b8-c8ed-4072-b097-3cdf25b07b70 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 29 20:07:31.550457 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 29 20:07:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:31.562785 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:32.024163 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-51443e8b-1ac5-42d0-b2dd-c004edcbbb85 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:32.045900 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-51443e8b-1ac5-42d0-b2dd-c004edcbbb85 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.488935 Aug 29 20:07:32.046448 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 33/64] 10.222.0.73 () {60 vars in 1292 bytes} [Mon Aug 29 20:07:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:07:32.067881 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:SELECT=14 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:32.071908 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-71fdb979-5d83-467c-adbf-8f5657cdf147 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:32.079813 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-71fdb979-5d83-467c-adbf-8f5657cdf147 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013319 Aug 29 20:07:32.080335 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 32/65] 10.222.0.73 () {60 vars in 1283 bytes} [Mon Aug 29 20:07:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:32.092084 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-169e6a5a-2a78-463e-b401-06d59ea12d25 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:32.099789 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-169e6a5a-2a78-463e-b401-06d59ea12d25 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011376 Aug 29 20:07:32.100320 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 34/66] 10.222.0.73 () {60 vars in 1286 bytes} [Mon Aug 29 20:07:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:32.112555 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:32.120251 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011349 Aug 29 20:07:32.120767 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 33/67] 10.222.0.73 () {60 vars in 1286 bytes} [Mon Aug 29 20:07:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:32.132947 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-ba9d84d5-c112-410e-a413-9d4a9f3ff3d1 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:32.140833 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-ba9d84d5-c112-410e-a413-9d4a9f3ff3d1 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011473 Aug 29 20:07:32.141341 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 35/68] 10.222.0.73 () {60 vars in 1283 bytes} [Mon Aug 29 20:07:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:10:31.215424 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:10:31.216436 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 29 20:10:31.216864 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 34/69] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:10:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:10:31.368294 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_api:SELECT=6 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:31.604854 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-3e0b57b5-83b6-482d-aa8f-caf95bada52c admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:10:31.610715 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-3e0b57b5-83b6-482d-aa8f-caf95bada52c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:10:31.611212 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-3e0b57b5-83b6-482d-aa8f-caf95bada52c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:10:31.611675 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-3e0b57b5-83b6-482d-aa8f-caf95bada52c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:10:31.615313 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-3e0b57b5-83b6-482d-aa8f-caf95bada52c admin admin] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:10:31.615313 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-3e0b57b5-83b6-482d-aa8f-caf95bada52c admin admin] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:10:31.615313 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-3e0b57b5-83b6-482d-aa8f-caf95bada52c admin admin] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:10:31.659350 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-3e0b57b5-83b6-482d-aa8f-caf95bada52c admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.292309 Aug 29 20:10:31.660135 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 36/70] 10.222.0.73 () {60 vars in 1193 bytes} [Mon Aug 29 20:10:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:10:32.669608 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:10:32.670766 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 29 20:10:32.671199 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 35/71] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:10:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:10:32.881890 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-fefbf909-728b-4860-be55-44c61f8cb313 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:10:32.885682 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-fefbf909-728b-4860-be55-44c61f8cb313 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:10:32.886191 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-fefbf909-728b-4860-be55-44c61f8cb313 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:10:32.886624 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-fefbf909-728b-4860-be55-44c61f8cb313 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:10:32.887352 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-fefbf909-728b-4860-be55-44c61f8cb313 admin admin] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:10:32.887803 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-fefbf909-728b-4860-be55-44c61f8cb313 admin admin] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:10:32.888222 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-fefbf909-728b-4860-be55-44c61f8cb313 admin admin] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:10:32.908735 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-fefbf909-728b-4860-be55-44c61f8cb313 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090879 Aug 29 20:10:32.909429 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 37/72] 10.222.0.73 () {60 vars in 1193 bytes} [Mon Aug 29 20:10:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:10:44.160334 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:10:44.161330 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 29 20:10:44.161735 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 36/73] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:10:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:10:44.304804 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_cell0:SELECT=4 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:44.305522 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_cell1:SELECT=4 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:44.306144 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG dbcounter [-] [105761] Writing DB stats nova_api:SELECT=8 {{(pid=105761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:44.354394 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-788beee5-61f1-4190-b2cc-47c2865fc8d0 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:10:44.357826 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-788beee5-61f1-4190-b2cc-47c2865fc8d0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:10:44.358301 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-788beee5-61f1-4190-b2cc-47c2865fc8d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:10:44.358731 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-788beee5-61f1-4190-b2cc-47c2865fc8d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:10:44.359444 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-788beee5-61f1-4190-b2cc-47c2865fc8d0 admin admin] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:10:44.359897 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-788beee5-61f1-4190-b2cc-47c2865fc8d0 admin admin] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:10:44.360314 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-788beee5-61f1-4190-b2cc-47c2865fc8d0 admin admin] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:10:44.385482 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-788beee5-61f1-4190-b2cc-47c2865fc8d0 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085845 Aug 29 20:10:44.386072 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 38/74] 10.222.0.73 () {60 vars in 1193 bytes} [Mon Aug 29 20:10:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:10:45.211549 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:10:45.212547 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6e44b840-1bc1-4e2b-9bfc-e92527c82980 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 29 20:10:45.212941 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 37/75] 10.222.0.73 () {56 vars in 1074 bytes} [Mon Aug 29 20:10:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:10:45.404668 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG nova.api.openstack.wsgi [None req-35efdd45-a38d-483b-a7ff-47db27b82831 admin admin] Calling method '>' {{(pid=105761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:10:45.408108 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-35efdd45-a38d-483b-a7ff-47db27b82831 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:10:45.408582 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-35efdd45-a38d-483b-a7ff-47db27b82831 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:10:45.409010 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-35efdd45-a38d-483b-a7ff-47db27b82831 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:10:45.409753 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-35efdd45-a38d-483b-a7ff-47db27b82831 admin admin] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:10:45.410206 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-35efdd45-a38d-483b-a7ff-47db27b82831 admin admin] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:10:45.410625 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: DEBUG oslo_concurrency.lockutils [None req-35efdd45-a38d-483b-a7ff-47db27b82831 admin admin] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:10:45.432456 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: INFO nova.api.openstack.requestlog [None req-35efdd45-a38d-483b-a7ff-47db27b82831 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080637 Aug 29 20:10:45.432949 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: [pid: 105761|app: 0|req: 39/76] 10.222.0.73 () {60 vars in 1193 bytes} [Mon Aug 29 20:10:45 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:11:44.180312 dv-cinder-854261-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 20:11:44.180917 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: Mon Aug 29 20:11:44 2022 - graceful shutdown triggered... Aug 29 20:11:44.181376 dv-cinder-854261-2-iscsi devstack@n-api.service[105760]: Gracefully killing worker 1 (pid: 105760)... Aug 29 20:11:44.182589 dv-cinder-854261-2-iscsi devstack@n-api.service[105761]: Gracefully killing worker 2 (pid: 105761)... Aug 29 20:11:45.182148 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: worker 1 buried after 1 seconds Aug 29 20:11:45.182148 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: worker 2 buried after 1 seconds Aug 29 20:11:45.182148 dv-cinder-854261-2-iscsi devstack@n-api.service[105759]: goodbye to uWSGI. Aug 29 20:11:45.183665 dv-cinder-854261-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 20:11:45.184226 dv-cinder-854261-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 20:11:45.187775 dv-cinder-854261-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 20:11:45.197233 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 20:11:45.199957 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:11:45 2022] *** Aug 29 20:11:45.200112 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:11:45.200245 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: nodename: dv-cinder-854261-2-iscsi Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: machine: x86_64 Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: clock source: unix Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: pcre jit disabled Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: detected number of CPU cores: 4 Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: current working directory: / Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: your processes number limit is 47680 Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: your memory page size is 4096 bytes Aug 29 20:11:45.200375 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: detected max file descriptor number: 2048 Aug 29 20:11:45.202387 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: lock engine: pthread robust mutexes Aug 29 20:11:45.202387 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: thunder lock: enabled Aug 29 20:11:45.202387 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 20:11:45.202387 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:11:45.240584 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: Python main interpreter initialized at 0x557be7ed19c0 Aug 29 20:11:45.240584 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: python threads support enabled Aug 29 20:11:45.240584 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: your server socket listen backlog is limited to 100 connections Aug 29 20:11:45.240584 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:11:45.241058 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:11:45.241058 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: *** Operational MODE: preforking *** Aug 29 20:11:45.241305 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:11:45.241305 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: spawned uWSGI master process (pid: 120775) Aug 29 20:11:45.241531 dv-cinder-854261-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 20:11:45.243932 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: spawned uWSGI worker 1 (pid: 120787, cores: 1) Aug 29 20:11:45.243932 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: spawned uWSGI worker 2 (pid: 120788, cores: 1) Aug 29 20:11:45.243932 dv-cinder-854261-2-iscsi devstack@n-api.service[120775]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:11:45.927258 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:11:45.943791 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:11:47.094016 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:11:47.094016 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: from cryptography.utils import int_from_bytes Aug 29 20:11:47.094567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:11:47.094567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: from cryptography.utils import int_from_bytes Aug 29 20:11:47.126999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:11:47.126999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: from cryptography.utils import int_from_bytes Aug 29 20:11:47.127533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:11:47.127533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: from cryptography.utils import int_from_bytes Aug 29 20:11:49.528069 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:11:49.528682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:11:49.529345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:11:49.529689 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:11:49.529958 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:11:49.530354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.530683 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.531005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.531325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.531817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.532134 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.532462 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.532783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.533114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.533376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.533692 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.534040 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854261-2-iscsi {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.534365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.534679 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.534991 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.535311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.535623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.535950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.536257 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.536765 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.538102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.538102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.538102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.538390 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.538478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.538786 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.539108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.539416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.539746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.540059 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.540467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854261-2-iscsi {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.540786 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.541097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.541408 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.541856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.542169 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.542476 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.542796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.543115 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.543423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.543764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.544080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.544433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.544851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.545160 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.545472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.545912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.546123 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.546424 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.546731 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.546980 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.547285 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.547608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.547927 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.548253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.548502 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.548754 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.549074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.549395 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.549721 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.550047 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.550366 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.550658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.550963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.551269 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.551575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.551880 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.552201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.552518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.552843 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.553148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.553466 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.553903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.554156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.554463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.554813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.555132 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.555439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.555759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.556084 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.556394 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.556702 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.557008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.557327 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.557666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.557998 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.558262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.558553 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.558856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.559173 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.559478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.559781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.560121 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.560467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.560771 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.561078 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.561384 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.561687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.562010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.562316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.562621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.562926 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.563229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.563551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.563870 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.564176 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.564481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.564792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.565096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.565415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.565737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.566046 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.566368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.566679 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.566984 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.567302 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.567606 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.567914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.568229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.568527 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.568831 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.569150 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.569457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.569809 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.570105 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.570408 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.570710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.571015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.571320 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.571623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.571922 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.572244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.572568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.572879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.573183 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.573488 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.573830 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.574174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.574507 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.574857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.575170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.575503 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.576415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.576735 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.577049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.577363 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.577689 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.578025 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.578336 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.578648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.578967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.579284 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.579612 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.579928 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.580242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.580561 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.580874 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.581189 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.581517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.581865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.582176 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.582517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.582866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.583181 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.583508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.583835 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.584150 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.584462 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.584774 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.585103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.585437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.585769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.586089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.586401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.586722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.587035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.587345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.587657 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.587967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.588278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.588613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.588927 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.589250 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.589565 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.589901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.590220 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.590531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.590841 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.591172 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.592062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.592628 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.593030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.593351 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.593663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.594014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.594347 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.594660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.594995 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.595309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.595626 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.595939 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.596253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.596560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.596876 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.597187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.597491 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.597837 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.598234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.598569 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.598894 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.599201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.599508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.599824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.600221 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.600533 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.600846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.601158 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.601480 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.601817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.602128 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.602464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.602792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.603098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.603420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.603744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.604058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.604359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.604615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:11:49.605034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.605112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:11:49.605182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.605277 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.605522 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:11:49.605680 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.605860 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.605944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:11:49.606152 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:11:49.606241 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.606452 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.606547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.606755 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.606895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.607230 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.607394 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.607558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.607742 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.607912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.608188 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.608305 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.608507 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.608615 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.608810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.608892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.609116 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.609208 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.609467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.609634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.609765 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.610063 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.610157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.610392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854261-2-iscsi {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.610512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.610718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.610859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.611029 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.611186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.611344 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.611518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.611666 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.611836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.611972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.612160 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.612297 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.612477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.612607 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.612793 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.613108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.613190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.613423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.613514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.613750 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.613849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.614069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.614160 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.614390 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.614481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.614704 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.614794 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.615015 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.615095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.615335 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.615436 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.615644 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.615735 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.615947 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.616049 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.616265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.616368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.616608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.616714 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854261-2-iscsi {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.616941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.617046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.617259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.617352 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.617572 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.617672 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.617907 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.618009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.618240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.618357 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.618531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.618633 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.618842 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.618950 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.619153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.619248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.619463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.619557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.619781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.619885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.620092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.620186 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.620408 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.620510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.620719 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.620832 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.621042 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.621136 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.621353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.621448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.621694 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.622031 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.622353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.622620 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.622790 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.623108 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.623368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.623620 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.623792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.623932 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.624113 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.624204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.624443 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.624548 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.624759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.624864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.625074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.625178 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.625396 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.625493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.625699 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.625833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.626017 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.626125 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.626343 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.626440 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.626652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.626771 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.626976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.627126 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.627300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.627440 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.627609 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.627739 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.628011 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.628374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.628531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.628632 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.628731 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.628869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.628978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.629180 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.629283 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.629493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.629596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.629843 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.630029 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.630167 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.630256 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.630480 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.630584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.630785 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.630894 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.631091 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.631194 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.631413 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.631516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.631728 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.631903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.632049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.632154 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.632356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.632452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.632664 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.632760 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.633009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.633116 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.633323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.633418 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.633631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.633743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.633978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.634074 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.634301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.634402 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.634614 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.634718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.634930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.635024 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.635245 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.635339 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.635553 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.635656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.635810 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.635911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.636116 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.636220 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.636424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.636526 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.636745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.636848 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.637053 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.637162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.637359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.637453 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.637665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.637794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.638543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.638740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.638934 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.639056 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.639252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.639365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.639566 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.639686 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.639871 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.639966 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.640182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.640277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.640502 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.640609 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.640812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.641081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.641175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.641416 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.641517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.641747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.641845 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.642070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.642175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.642634 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.642785 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.642943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.643045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.643250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.643357 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.643559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.643653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.643883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.643987 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.644193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.644288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.644502 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.644610 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.644807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.644901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.645110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.645214 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.645419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.645523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.645837 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.645940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.646052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.646147 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.646357 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.646470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.646666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.646761 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.646968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.647068 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.647269 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.647376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.647571 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.647674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.647874 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.648008 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.648211 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.648322 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.648514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.648656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.648825 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.648955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.649129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.649252 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.649463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.649586 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.649796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.649926 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.650101 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.650257 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.650394 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.650515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.650695 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.650817 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.651038 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.651161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.651342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.651464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.651664 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.651783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.651973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.652094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.652294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:11:49.652422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.652615 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.652752 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.653115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.653257 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.653375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.653493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.653606 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.654453 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.654652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.654782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.654936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.655240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.655513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.655656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.655777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.655925 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.656019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.656164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.656272 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.656481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.656577 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.656794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.656887 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.657106 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.657212 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.657419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.657514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.657943 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.658096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.658214 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.658315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.658391 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.658463 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.658669 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.658895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.659228 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.659547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.659870 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.660002 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.660204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.660301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.660532 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.660627 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.660856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.660981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.661177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.661342 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.661509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.661677 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.661847 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.662020 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.662114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.662353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.662458 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.662681 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.662775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.663000 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.663104 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.663316 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.663423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.663627 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.663727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.663941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.664043 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.664250 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.664353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.664578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.664672 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.664894 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.664988 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.665202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.665305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.665508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.665637 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.665850 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.665959 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.666159 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.666262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.666464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.666693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.666796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.666891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.667090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.667194 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.667407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.667519 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.667711 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.667820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.668023 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.668119 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.668326 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.668418 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.668632 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.668735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.668936 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.669040 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.669246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.669424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.669628 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.669830 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.669968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.670111 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.670280 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.670481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.670584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.670789 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.670892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.671099 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.671235 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.671425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.671538 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.671737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.671840 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.672042 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.672138 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.672347 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.672450 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.672649 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.672754 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.672993 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.673139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.673299 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.673438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.673635 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.673771 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.673977 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.674071 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.674292 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.674397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.674606 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.674706 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.674917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.675018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.675224 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.675317 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.675536 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.675637 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.675840 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.675934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.676148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.676237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.676458 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.676546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.676765 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.676845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.677066 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.677182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.677369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.677464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.677681 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.677884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.678017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.678120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.678329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.678423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.678644 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.678748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.678964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.679112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.679277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.679378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.680243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.680372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.680471 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.680560 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.680644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.680736 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.680834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.680934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.681021 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.681115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.681201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.681286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.681469 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.681604 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.681814 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.681936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.682129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.682249 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.682443 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.682548 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.682755 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.682851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.683065 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.683209 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.683381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.683513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.683693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.683803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.683999 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.684102 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.684320 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.684422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.684627 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.684722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.685482 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.685663 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.685882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.685968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.686271 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.686508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.686625 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.686796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.686927 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.687043 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.687299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.687420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.687622 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.687751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.687937 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.688067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.688245 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.688376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.688557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.688689 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.688870 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.689001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.689190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.689322 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.689507 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.689642 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.689838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.690010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.690258 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.690382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.690574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.690704 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.690884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.691014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.691196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.691319 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.691502 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.691632 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.691807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.691937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.692117 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.692248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.692442 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.692564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.692747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.692879 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.693053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.693185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.693370 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.693501 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.693696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.693821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.694022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.694206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.694357 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.694473 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.694777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.694881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.695103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.695207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.695410 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.695562 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.695830 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.695923 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.696144 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.696252 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.696463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.696566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.696786 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.696878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.697100 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.697209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.697413 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.697515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.697769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.697907 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.698071 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.698168 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.698387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.698482 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.698714 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.698810 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.699041 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.699137 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.699351 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.699444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.699667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.699767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.699972 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.700073 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.700287 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.700387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.700672 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.700987 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.701091 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.701311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.701414 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.701670 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.701785 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.702094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.702419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.702523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.702743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.702891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.703069 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.703216 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.703375 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.703536 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.703682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.703857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.703993 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.704170 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.704298 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.704484 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.704588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.704802 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.704897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.705128 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.705223 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.705445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.705539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.705821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.705973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.706146 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.706468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.706605 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.706771 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.706916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.707094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.707238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.707399 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.707544 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.707720 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.707874 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.708037 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.708174 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.708359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.708643 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.708779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.708960 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.709110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.709298 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.709440 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.709607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.709765 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.709943 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.710095 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.710262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.710406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.710566 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.710826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.710959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.711170 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.711317 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.711580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.711749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.711912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.712062 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.712254 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.712382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.712674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.712838 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.712980 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.713121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.713254 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.713523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.717742 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.717892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718445 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718632 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718723 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.718911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719004 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719103 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719290 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719466 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719553 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719649 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.719919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720197 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720283 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720553 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720801 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720874 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.720950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721023 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721105 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721186 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721260 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721330 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721734 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.721967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.722082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.722281 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.722386 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.722599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.722701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.722915 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.723017 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.723231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.723370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.723544 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.723723 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.723898 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.724057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.724177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.724394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.724499 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.724692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.724806 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.725012 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.725113 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.725326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.725594 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.725729 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.725950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.726052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.726267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.726366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.726577 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.726681 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.726891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.727003 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.727203 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.727302 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.727511 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.727610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.727836 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.727937 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.728126 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.728225 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.728436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.728528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.728746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.728847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.729052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.729143 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.729368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.729460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.729682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.729838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.730039 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.730144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.730359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.730471 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.730674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.730777 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.730983 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.731148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.731307 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.731458 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.731627 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.731868 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.732506 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.732722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.732872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.733012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.733159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.733463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.733564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.733663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.733782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.733946 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.734156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.734367 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.734607 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.734817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.734938 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.735053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.735165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.735276 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.735399 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.735521 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.735643 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.735764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.735903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.736077 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.736210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.736394 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.736516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.736723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.736864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.737088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.737217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.737375 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.737497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.737687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.737861 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.738024 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.738145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.738403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.738575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.738695 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.738946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.739073 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.739256 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.739385 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.739565 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.739673 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.739884 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.739996 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.740196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.740306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.740505 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.740615 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.740820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.740913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.741124 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.741227 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.741443 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.741547 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.741784 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.741904 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.742157 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.742465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.742780 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.743250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.743413 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.743540 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.743643 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.743805 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.743962 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.744063 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.744190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.744312 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.744514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.744671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.744832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.744955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.745158 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.745263 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.745476 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.745578 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.745819 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.746122 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.746217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.746455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.746546 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.746762 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.746867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.747075 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.747173 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.747403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.747509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.747733 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.747912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.748073 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.748215 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.748332 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.748483 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.748636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.748838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.748983 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.749126 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.749269 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.749438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.749608 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.749814 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.749976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.750117 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.750261 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.750412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.750586 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.750732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.750876 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.751024 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.751176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.751327 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.751469 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.751616 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.751764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.751917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.752066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.752218 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.752368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.752521 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.752677 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.752825 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.752985 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.753144 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.753296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.753461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.753600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.753769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.753918 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.754076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.754219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.754380 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.754524 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.754674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.754899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.755009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.755090 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.755171 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.755358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.755485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.755664 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.755775 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.755967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.756068 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.756272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.756372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.756586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.756687 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.756899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.757014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.757223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.757339 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.757539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.757680 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.757901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.758082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.758216 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.758332 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.758517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.758640 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.758830 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.758925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.759141 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.759251 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.759455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.759549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.759771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.759875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.760085 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.760194 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.760400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.760631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.760727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.760968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.761069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.761292 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.761396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.761609 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.761724 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.761976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.762080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.762287 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.762388 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.762596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.762697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.762905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.763088 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.763279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.763481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.763690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.763857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.764002 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.764098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.764236 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.764344 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.764565 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.764665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.764918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.765034 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.765375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.765693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.765941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.766072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.766268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.766396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.766594 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.766713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.766911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.767029 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.767228 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.767616 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.767803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.767920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.768114 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.768241 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.768464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.768583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.768725 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.768976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.769296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.769614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.769951 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.770158 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.770294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.770497 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.770636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.770851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.770972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.771313 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.771441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.771599 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.771741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.771872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.771984 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.772150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.772448 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.772587 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.772779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.772909 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.773217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.773344 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.773520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.773899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.774082 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.774305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.774547 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.774778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.774926 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.775237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.775406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.775642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.775782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.775911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.776139 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.776296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.776510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.776756 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.776891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.777143 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.777282 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.777500 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.777736 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.777888 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.778198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.778340 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.778493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.779337 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.779573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.779790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.780001 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.780153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.780284 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.780420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.780686 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.780821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.781014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.781273 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.781405 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.781644 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.781820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.782003 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.782298 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.782441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.782596 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.782836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.782972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.783236 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.784109 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.784243 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.784387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.784517 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.784644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.784784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.784784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.785936 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.786100 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.786240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.786379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.786379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.786632 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.786769 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.786911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.787047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.787176 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.787303 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.787439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.787583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.787750 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.787885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.788021 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.788156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.788322 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.788468 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.788683 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.788997 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.789138 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.789460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.789646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.789925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.790060 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.790249 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.790387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.790599 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.790833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.790979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.791225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.791355 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.791563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.791740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.791885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.792177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.792318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.792524 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.792654 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.792858 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.793092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.793225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.793492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.793622 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.793871 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.794115 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.794373 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.795162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.795393 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.795393 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.795779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.796183 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.796183 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.796455 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.796583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.796583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.796832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.796968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.797173 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.797314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.797482 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.797697 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.797880 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.798136 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.798276 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.798467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.798677 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.798810 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.799083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.799224 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.799395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.799666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.799798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.800035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.800177 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.800342 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.800527 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.800659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.800976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.801113 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.801305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.801476 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.801629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.801948 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.802082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.802299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.802481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.802618 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.802875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.803006 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.803225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.803378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.803528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.803845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.803981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.804187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.804349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.804545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.804747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.804880 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.805257 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.805409 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.805627 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.805808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.806135 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.806434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.806565 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.806565 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.806808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.806945 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.807193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.807325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.807511 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.807725 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.807858 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.808127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.808259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.808444 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.808663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.808796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.809442 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.809721 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.809873 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.810112 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.810461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.810850 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.811328 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.811475 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.811696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.811841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.812080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.812218 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.812416 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.812606 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.812748 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.813112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.813264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.813438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.813617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.813807 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.814096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.814246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.814451 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.814694 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.814836 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.815037 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.815170 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.815412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.815556 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.815693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.816033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.816552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.816718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.816860 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.817001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.817001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.817253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.817389 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.817518 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.817677 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.817892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.818127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.818259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.818533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.818703 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.819037 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.819176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.819400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.819529 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.819915 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.820065 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.820264 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.820395 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.820604 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.820818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.820952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.821229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:11:49.821376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.821564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.821919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.822254 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.822567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.822880 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.823199 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.823515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.823827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.824155 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.824489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.824784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.825108 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.825499 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.826160 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.826525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.826830 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.827140 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.827474 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.827798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.828113 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.828486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.828754 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.829067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.829389 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.829720 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.830042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.830478 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.830749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.830976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.831284 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.831601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.831911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.832242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.832552 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.832866 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.833175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.834083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.834396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.834713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.835027 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.835339 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.835660 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.835971 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.836290 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.836602 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.836928 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.837228 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.837546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.837938 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.838274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.838589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.838902 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.839231 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.839549 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.839878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.840200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.840516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.840872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.841760 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.842326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.843954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.843954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.843954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.843954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.843954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.844721 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.844721 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.845162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.845162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.845467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.845812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.846130 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.846447 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.846759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.847108 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.847375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.847696 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.848010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.848324 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.848641 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.849546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.849901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.850227 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.850580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.850909 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.851235 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.851558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.851881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.852197 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.852513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.852829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.853145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.853939 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.853939 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.855220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.855745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.856400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.859009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.859009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.859009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.859009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.859009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.859009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.859009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.859009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.860467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.860467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.860747 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.860949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.861336 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.861655 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.862018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.865204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.865204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.866144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.866405 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.866707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.867038 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.867374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.867701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.868025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.868347 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.868928 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.869237 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.869406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.869602 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.869950 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.870268 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.870586 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.870900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.871221 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.871547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.871850 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.872163 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.877439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.877439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.877439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.877439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.877439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.877439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.877439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.877439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.878703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.878703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.878703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.878703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.878703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.878703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.878703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.878703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.879882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.879882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.879882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.879882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.879882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.881055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.881055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.881055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.881460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.881460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.881826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.882047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.882384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.883055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.883055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.883957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.884302 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.884631 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.884965 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.885885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.885885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.886212 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.886869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.887220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.887560 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.887883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.888834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.889225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.890217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.890217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.890217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.891175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.891175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.891175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.891585 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:11:49.891725 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:11:49.895160 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO dbcounter [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Registered counter for database nova_api Aug 29 20:11:49.916471 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:11:49.923791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writer thread running {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:11:49.955372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO dbcounter [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Registered counter for database nova_api Aug 29 20:11:49.975860 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_db.sqlalchemy.engines [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:11:49.982251 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.context [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87b86c2a-8fe9-4ea5-824e-801d166189f2(cell1) {{(pid=120787) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:11:49.982687 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writer thread running {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:11:49.986337 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:49.986817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:49.988401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:49.989131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:49.989578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:49.991616 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:49.993932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO dbcounter [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Registered counter for database nova_cell0 Aug 29 20:11:49.998908 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO dbcounter [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Registered counter for database nova_cell1 Aug 29 20:11:50.007780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:11:50.010085 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:11:50.018422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writer thread running {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:11:50.019700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writer thread running {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:11:50.040974 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.context [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87b86c2a-8fe9-4ea5-824e-801d166189f2(cell1) {{(pid=120788) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:11:50.044986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:50.045479 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:50.047070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:50.047805 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:50.048250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:50.050275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:50.052258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO dbcounter [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Registered counter for database nova_cell0 Aug 29 20:11:50.056280 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO dbcounter [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Registered counter for database nova_cell1 Aug 29 20:11:50.064191 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_db.sqlalchemy.engines [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:11:50.069296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writer thread running {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:11:50.069967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_db.sqlalchemy.engines [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:11:50.176014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO dbcounter [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Registered counter for database nova_cell0 Aug 29 20:11:50.183197 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:11:50.188413 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writer thread running {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:11:50.216471 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writer thread running {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:11:50.226299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO dbcounter [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Registered counter for database nova_cell0 Aug 29 20:11:50.233923 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_db.sqlalchemy.engines [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:11:50.238647 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writer thread running {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:11:50.507344 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: WARNING keystonemiddleware.auth_token [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:11:50.514758 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: WARNING keystonemiddleware.auth_token [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:11:50.564469 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: WARNING keystonemiddleware.auth_token [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:11:50.571800 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: WARNING keystonemiddleware.auth_token [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:11:50.856000 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: WARNING keystonemiddleware.auth_token [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:11:50.862173 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: WARNING keystonemiddleware.auth_token [None req-d1e1abbe-96bf-42e2-8fc4-b7b33f6d86bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:11:50.867611 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557be7ed19c0 pid: 120787 (default app) Aug 29 20:11:50.918511 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: WARNING keystonemiddleware.auth_token [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:11:50.924704 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: WARNING keystonemiddleware.auth_token [None req-f77f1da8-5c21-419f-8286-bce3130ecad3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:11:50.930075 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557be7ed19c0 pid: 120788 (default app) Aug 29 20:12:28.291897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:28.293675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:28.294769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:28.295795 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:29.995789 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5318a7d4-aeac-45a1-855d-01a332608d2f tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Action: 'create', calling method: .version_select at 0x7f15fadf3ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-295935764", "metadata": {"Type": "work"}}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5318a7d4-aeac-45a1-855d-01a332608d2f tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Request method failure captured: Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 121 Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR2sArclZzEb-HMPlKg8GbLI40XESJsmV4w0eBYj62u7aP3KPRXmu8FT2vLfemEh-UcJdKqbYinByI69VVEi4Y0MLgbFXKyP01frZTFNEww9dzTTjKc7MCDQmUvQtUTlCwx1kM5zbY9sQcVcAWAYwQcVEkp0HhYYsqiXbk8-UiYI86s Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:12:30.007766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}] Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 8a55334adb294937abaf0c2bef36be3e Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-295935764", "metadata": {"Type": "work"}}} Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: Aug 29 20:12:30.009213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-295935764', 'metadata': {'Type': 'work'}}}} Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:12:30.010174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:12:30.011508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:12:30.012814 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:12:30.012814 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.014844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5318a7d4-aeac-45a1-855d-01a332608d2f tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:12:30.016842 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5318a7d4-aeac-45a1-855d-01a332608d2f tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.735119 Aug 29 20:12:30.023927 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1156 bytes} [Mon Aug 29 20:12:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1743 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:12:30.612418 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7fbe4c64-f60c-42a5-b2bf-00bedbd5e310 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Action: 'create', calling method: .version_select at 0x7f15fae56940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1668202354", "metadata": {"Type": "work"}}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7fbe4c64-f60c-42a5-b2bf-00bedbd5e310 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Request method failure captured: Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 120 Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR2sArclZzEb-HMPlKg8GbLI40XESJsmV4w0eBYj62u7aP3KPRXmu8FT2vLfemEh-UcJdKqbYinByI69VVEi4Y0MLgbFXKyP01frZTFNEww9dzTTjKc7MCDQmUvQtUTlCwx1kM5zbY9sQcVcAWAYwQcVEkp0HhYYsqiXbk8-UiYI86s Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:12:30.632497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}] Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 8a55334adb294937abaf0c2bef36be3e Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1668202354", "metadata": {"Type": "work"}}} Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: Aug 29 20:12:30.634815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1668202354', 'metadata': {'Type': 'work'}}}} Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi '0' Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:12:30.635651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:12:30.636900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:12:30.639238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:12:30.639238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.639238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7fbe4c64-f60c-42a5-b2bf-00bedbd5e310 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:12:30.639238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7fbe4c64-f60c-42a5-b2bf-00bedbd5e310 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.608022 Aug 29 20:12:30.639238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 1/2] 10.222.0.73 () {60 vars in 1156 bytes} [Mon Aug 29 20:12:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 611 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:12:30.647855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-99593c74-713c-4565-b20e-b49f57467951 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Action: 'create', calling method: .version_select at 0x7f15fad429d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-117208323", "metadata": {"Type": "work"}}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-99593c74-713c-4565-b20e-b49f57467951 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Request method failure captured: Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 118 Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR2sArclZzEb-HMPlKg8GbLI40XESJsmV4w0eBYj62u7aP3KPRXmu8FT2vLfemEh-UcJdKqbYinByI69VVEi4Y0MLgbFXKyP01frZTFNEww9dzTTjKc7MCDQmUvQtUTlCwx1kM5zbY9sQcVcAWAYwQcVEkp0HhYYsqiXbk8-UiYI86s Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:12:30.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}] Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 8a55334adb294937abaf0c2bef36be3e Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-117208323", "metadata": {"Type": "work"}}} Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: Aug 29 20:12:30.653230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-117208323', 'metadata': {'Type': 'work'}}}} Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi '' Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:12:30.654259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:12:30.656179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:12:30.657429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:12:30.657429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:30.657429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-99593c74-713c-4565-b20e-b49f57467951 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:12:30.657429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-99593c74-713c-4565-b20e-b49f57467951 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010265 Aug 29 20:12:30.657429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 2/3] 10.222.0.73 () {60 vars in 1156 bytes} [Mon Aug 29 20:12:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:12:30.662980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:30.663808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:30.664497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:30.665410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:30.685745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1141e665-6012-44ee-8f29-d5e853084b5c tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Calling method '.version_select at 0x7f15fade13a0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:32.493231 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-1141e665-6012-44ee-8f29-d5e853084b5c tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] HTTP exception thrown: Volume tempest-invalid-91808330 could not be found. Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1141e665-6012-44ee-8f29-d5e853084b5c tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Request method failure captured: Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-91808330 HTTP/1.1 Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR2sArclZzEb-HMPlKg8GbLI40XESJsmV4w0eBYj62u7aP3KPRXmu8FT2vLfemEh-UcJdKqbYinByI69VVEi4Y0MLgbFXKyP01frZTFNEww9dzTTjKc7MCDQmUvQtUTlCwx1kM5zbY9sQcVcAWAYwQcVEkp0HhYYsqiXbk8-UiYI86s Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:12:32.498944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}] Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 8a55334adb294937abaf0c2bef36be3e Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Volume tempest-invalid-91808330 could not be found. Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'tempest-invalid-91808330'} Aug 29 20:12:32.499972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-91808330 could not be found. (HTTP 404) (Request-ID: req-73ff8927-c0a6-4245-8ecc-ec1873c42a22) Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:32.500512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:12:32.501372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-91808330 could not be found. Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:12:32.502815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-91808330 could not be found. Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-91808330 could not be found. Aug 29 20:12:32.503682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.506556 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1141e665-6012-44ee-8f29-d5e853084b5c tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Returning 404 to user: Volume tempest-invalid-91808330 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:12:32.508048 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1141e665-6012-44ee-8f29-d5e853084b5c tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-91808330" status: 404 len: 97 microversion: 2.1 time: 1.845965 Aug 29 20:12:32.516900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1212 bytes} [Mon Aug 29 20:12:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-91808330 => generated 97 bytes in 1856 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:12:32.518667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-13afedac-2cd1-4405-9508-03b89ffc5994 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003619 Aug 29 20:12:32.519690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 3/5] 10.222.0.73 () {58 vars in 1140 bytes} [Mon Aug 29 20:12:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 20:12:32.534580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9cf37c1e-c9b0-4188-b1de-4569de6196d7 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008149 Aug 29 20:12:32.560509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 3/6] 10.222.0.73 () {58 vars in 1137 bytes} [Mon Aug 29 20:12:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 20:12:32.566179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5b701f17-ba7f-4733-ba4d-924a0bc89684 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Calling method '.version_select at 0x7f15facbeca0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:32.972463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-5b701f17-ba7f-4733-ba4d-924a0bc89684 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] HTTP exception thrown: Volume ac2620d4-1c44-4106-baf6-59787d8c5d82 could not be found. Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5b701f17-ba7f-4733-ba4d-924a0bc89684 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Request method failure captured: Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: DELETE /compute/v2.1/os-volumes/ac2620d4-1c44-4106-baf6-59787d8c5d82 HTTP/1.1 Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR2sArclZzEb-HMPlKg8GbLI40XESJsmV4w0eBYj62u7aP3KPRXmu8FT2vLfemEh-UcJdKqbYinByI69VVEi4Y0MLgbFXKyP01frZTFNEww9dzTTjKc7MCDQmUvQtUTlCwx1kM5zbY9sQcVcAWAYwQcVEkp0HhYYsqiXbk8-UiYI86s Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:12:32.976658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}] Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 8a55334adb294937abaf0c2bef36be3e Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Volume ac2620d4-1c44-4106-baf6-59787d8c5d82 could not be found. Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'ac2620d4-1c44-4106-baf6-59787d8c5d82'} Aug 29 20:12:32.977813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ac2620d4-1c44-4106-baf6-59787d8c5d82 could not be found. (HTTP 404) (Request-ID: req-33ad24b3-b8e2-49ff-b6d7-53e87f300823) Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:32.978608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:12:32.979751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ac2620d4-1c44-4106-baf6-59787d8c5d82 could not be found. Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:12:32.980810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ac2620d4-1c44-4106-baf6-59787d8c5d82 could not be found. Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ac2620d4-1c44-4106-baf6-59787d8c5d82 could not be found. Aug 29 20:12:32.981944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:12:32.983411 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5b701f17-ba7f-4733-ba4d-924a0bc89684 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Returning 404 to user: Volume ac2620d4-1c44-4106-baf6-59787d8c5d82 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:12:32.984465 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5b701f17-ba7f-4733-ba4d-924a0bc89684 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/ac2620d4-1c44-4106-baf6-59787d8c5d82" status: 404 len: 109 microversion: 2.1 time: 0.422211 Aug 29 20:12:32.986939 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:12:32 2022] DELETE /compute/v2.1/os-volumes/ac2620d4-1c44-4106-baf6-59787d8c5d82 => generated 109 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:12:32.995833 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-61dd6c9f-9506-4a1a-bd1c-cd22a15487a8 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Calling method '.version_select at 0x7f15fabfd4c0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:33.260500 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-61dd6c9f-9506-4a1a-bd1c-cd22a15487a8 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] HTTP exception thrown: Volume e8b92052-ae7e-447a-b940-51780513abf7 could not be found. Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-61dd6c9f-9506-4a1a-bd1c-cd22a15487a8 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Request method failure captured: Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/os-volumes/e8b92052-ae7e-447a-b940-51780513abf7 HTTP/1.1 Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR2sArclZzEb-HMPlKg8GbLI40XESJsmV4w0eBYj62u7aP3KPRXmu8FT2vLfemEh-UcJdKqbYinByI69VVEi4Y0MLgbFXKyP01frZTFNEww9dzTTjKc7MCDQmUvQtUTlCwx1kM5zbY9sQcVcAWAYwQcVEkp0HhYYsqiXbk8-UiYI86s Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:12:33.262697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cbb0922aa97f4f39bb7a426a0a94ffb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cbb0922aa97f4f39bb7a426a0a94ffb1"}]}] Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: cbb0922aa97f4f39bb7a426a0a94ffb1 Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesNegativeTest-1217756294 Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 8a55334adb294937abaf0c2bef36be3e Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesNegativeTest-1217756294-project Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Volume e8b92052-ae7e-447a-b940-51780513abf7 could not be found. Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'e8b92052-ae7e-447a-b940-51780513abf7'} Aug 29 20:12:33.264350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8b92052-ae7e-447a-b940-51780513abf7 could not be found. (HTTP 404) (Request-ID: req-fae47ac2-7de6-4060-934d-b7553b6647e2) Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:33.264964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:12:33.265856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8b92052-ae7e-447a-b940-51780513abf7 could not be found. Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:12:33.271957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8b92052-ae7e-447a-b940-51780513abf7 could not be found. Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8b92052-ae7e-447a-b940-51780513abf7 could not be found. Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-61dd6c9f-9506-4a1a-bd1c-cd22a15487a8 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] Returning 404 to user: Volume e8b92052-ae7e-447a-b940-51780513abf7 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-61dd6c9f-9506-4a1a-bd1c-cd22a15487a8 tempest-VolumesNegativeTest-1217756294 tempest-VolumesNegativeTest-1217756294-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/e8b92052-ae7e-447a-b940-51780513abf7" status: 404 len: 109 microversion: 2.1 time: 0.274595 Aug 29 20:12:33.274489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:12:32 2022] GET /compute/v2.1/os-volumes/e8b92052-ae7e-447a-b940-51780513abf7 => generated 109 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:12:43.523922 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6f59fcfd-b9d8-4e48-ab29-cc57c7491a18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'create', calling method: .version_select at 0x7f15fac02790>, body: {"keypair": {"name": "tempest-keypair-845302019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvr3pE5DHN5BBtSL7/25kEDnx4jT8+RL2nPovn99mbgLqyNNytgfYir7rIUQ9GKziveAZc/kHWSvAIBSF+UwIlRWL0C1oh7zF57xeg4fS08jrgtyUeR+I1/zysb2LQQvA=="}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:12:43.617266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-6f59fcfd-b9d8-4e48-ab29-cc57c7491a18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Getting quotas for project 6fb06a5fd3a3482d991c542ccc993e88. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:12:43.627024 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-6f59fcfd-b9d8-4e48-ab29-cc57c7491a18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Getting quotas for user 04c2aae2da284df29243b99d33725ddd and project 6fb06a5fd3a3482d991c542ccc993e88. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:12:43.741237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6f59fcfd-b9d8-4e48-ab29-cc57c7491a18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.177064 Aug 29 20:12:43.745047 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 5/9] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:12:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:12:45.174729 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1282852033", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:12:45.458831 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] validate_networks() for [('dca5aa8c-453f-4b91-91f7-9d11ae5d1e40', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:12:47.963960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1360574579", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "networks": [{"uuid": "d8752937-08ea-43a9-a2dc-4f02a63b3a95"}]}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:12:48.089163 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] validate_networks() for [('d8752937-08ea-43a9-a2dc-4f02a63b3a95', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:12:48.578654 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:12:48.579173 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:12:48.579588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:12:48.580045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:12:48.580460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:12:48.624549 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:48.631996 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:48.633125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:48.637283 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:48.641809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:48.642232 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:48.731535 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Getting quotas for project bbb0263903e14938b44d9a6b430d84ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:12:48.747157 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Getting quotas for user e75b537d44524de192282b10825293f9 and project bbb0263903e14938b44d9a6b430d84ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:12:48.785636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:12:48.793110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:12:48.981579 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-891b4748-e58a-42e9-b703-4a3f3032b36a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.094379 Aug 29 20:12:48.988858 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 5/10] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:12:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 4096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:12:48.995595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1783610414", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03a78358-12e5-4261-9033-2937f1d7bd0b"}], "security_groups": [{"name": "tempest-securitygroup--926463085"}], "key_name": "tempest-keypair-845302019", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:12:49.340626 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] validate_networks() for [('03a78358-12e5-4261-9033-2937f1d7bd0b', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:12:50.261051 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:12:50.262849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:12:50.263712 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:12:50.264291 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:12:50.264850 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:12:50.290172 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:50.291586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:50.292492 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:50.293454 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:50.300839 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:50.301386 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:50.418219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Getting quotas for project bcff03cfe90e4d1bb5f9bf1564edafa6. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:12:50.438795 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Getting quotas for user 2420a84d76e845c68bd14852b1a910a9 and project bcff03cfe90e4d1bb5f9bf1564edafa6. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:12:50.466751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:12:50.470474 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:12:50.510041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:12:50.510686 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:12:50.511399 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:12:50.520472 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:12:50.521255 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:12:50.552080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:50.555409 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:50.557600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:50.558749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:50.559522 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:50.560191 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:50.592513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Getting quotas for project 6fb06a5fd3a3482d991c542ccc993e88. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:12:50.597743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Getting quotas for user 04c2aae2da284df29243b99d33725ddd and project 6fb06a5fd3a3482d991c542ccc993e88. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:12:50.613934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:12:50.616722 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:12:50.672339 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7526a05f-e386-4721-88e7-3e5abf0305fd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.534186 Aug 29 20:12:50.678818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 6/11] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:12:50.707231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6a1d9bc7-439f-45aa-a608-52a7c9e99442 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:50.708498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6a1d9bc7-439f-45aa-a608-52a7c9e99442 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:50.737691 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-84648103-b542-4628-8c50-3e0508f59213 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.753410 Aug 29 20:12:50.738549 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 6/12] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:12:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:12:50.744201 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7ee904cd-a4a5-4621-ad7d-18c469101c40 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:50.745002 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7ee904cd-a4a5-4621-ad7d-18c469101c40 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:50.959516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6a1d9bc7-439f-45aa-a608-52a7c9e99442 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:50.997035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6a1d9bc7-439f-45aa-a608-52a7c9e99442 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1222 microversion: 2.1 time: 0.312699 Aug 29 20:12:51.003045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:50 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1222 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:51.019110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d12e1ac6-2613-4cf5-8700-efcbc4f7e933 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:51.023272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d12e1ac6-2613-4cf5-8700-efcbc4f7e933 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:51.036805 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7ee904cd-a4a5-4621-ad7d-18c469101c40 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:51.111719 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7ee904cd-a4a5-4621-ad7d-18c469101c40 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1215 microversion: 2.1 time: 0.362523 Aug 29 20:12:51.118841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 7/14] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:50 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1215 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:51.236958 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d12e1ac6-2613-4cf5-8700-efcbc4f7e933 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:51.246618 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d12e1ac6-2613-4cf5-8700-efcbc4f7e933 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1237 microversion: 2.1 time: 0.237985 Aug 29 20:12:51.251789 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 8/15] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:51 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1237 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:51.428506 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-307163373", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:12:51.637483 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] validate_networks() for [('dca5aa8c-453f-4b91-91f7-9d11ae5d1e40', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:12:52.142648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b6e6f9ca-a5a5-46a8-9127-df3fa4991a47 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:52.146185 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b6e6f9ca-a5a5-46a8-9127-df3fa4991a47 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:52.647950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b6e6f9ca-a5a5-46a8-9127-df3fa4991a47 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:52.673311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b6e6f9ca-a5a5-46a8-9127-df3fa4991a47 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1215 microversion: 2.1 time: 0.538383 Aug 29 20:12:52.683175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 9/16] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:52 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1215 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:52.699542 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-72cac2e3-feca-4752-95a4-87c3b93875c6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:52.700156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-72cac2e3-feca-4752-95a4-87c3b93875c6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:53.007949 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-72cac2e3-feca-4752-95a4-87c3b93875c6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:53.022342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-72cac2e3-feca-4752-95a4-87c3b93875c6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1237 microversion: 2.1 time: 0.337962 Aug 29 20:12:53.043830 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 10/17] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:52 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1237 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:53.248244 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:12:53.249390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:12:53.250609 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:12:53.251413 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:12:53.252214 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:12:53.286354 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:53.286988 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:53.289331 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:53.291089 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:53.295718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:53.297363 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:53.380023 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Getting quotas for project bbb0263903e14938b44d9a6b430d84ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:12:53.406825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Getting quotas for user e75b537d44524de192282b10825293f9 and project bbb0263903e14938b44d9a6b430d84ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:12:53.468796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:12:53.483541 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:12:53.677343 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3ffddb79-48ac-43b3-af01-182b4a087773 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.254677 Aug 29 20:12:53.678507 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 8/18] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:12:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:12:53.690866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a8c2336f-955e-4925-a703-294129b46afb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:53.691495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a8c2336f-955e-4925-a703-294129b46afb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:53.706018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:53.707563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:53.735961 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:53.738133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:53.741615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:53.743921 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:53.745667 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:53.750520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:53.951930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a8c2336f-955e-4925-a703-294129b46afb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:53.965080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a8c2336f-955e-4925-a703-294129b46afb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1221 microversion: 2.1 time: 0.278402 Aug 29 20:12:53.965686 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 11/19] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:53 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1221 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:54.048726 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:54.049352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:54.061223 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:54.061740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:54.092244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:54.098497 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:54.100925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:54.103711 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:54.404703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:54.471223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4b2d5626-adee-4f4d-a1c1-15e0a0eb20e2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1211 microversion: 2.1 time: 0.765558 Aug 29 20:12:54.472738 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 9/20] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:53 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1211 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:12:54.635250 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:54.662053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f022e824-23aa-431d-bd51-eac32f1ef256 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1289 microversion: 2.1 time: 0.617791 Aug 29 20:12:54.680772 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 12/21] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:54 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1289 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:12:54.995984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c7d2163f-2c8f-43f5-9272-402492dffa74 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:54.996849 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c7d2163f-2c8f-43f5-9272-402492dffa74 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:55.356162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c7d2163f-2c8f-43f5-9272-402492dffa74 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:55.371537 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c7d2163f-2c8f-43f5-9272-402492dffa74 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1221 microversion: 2.1 time: 0.381696 Aug 29 20:12:55.386972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 10/22] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:54 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1221 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:55.496660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:55.498981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:55.512868 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:55.514308 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:55.514976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:55.518599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:55.519088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:55.519704 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:55.689994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:55.690785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:55.706100 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:55.706881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:55.708547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:55.712545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:55.719155 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:55.719819 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:56.187646 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:56.202096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8d644743-4846-485a-acfa-d582ad69d2c4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1267 microversion: 2.1 time: 0.709315 Aug 29 20:12:56.210055 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 13/23] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:55 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1267 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:56.298218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:56.317901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-98c2bd05-02d9-411e-ab36-9f2a9a2b15c7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1297 microversion: 2.1 time: 0.633029 Aug 29 20:12:56.334517 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 11/24] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:55 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1297 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:56.403724 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:56.406520 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:56.429088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:56.431514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:56.438354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:56.439410 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:56.441135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:56.442716 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:56.628599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:56.648501 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bee2f008-5bec-4d9a-9124-295fac74e183 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1217 microversion: 2.1 time: 0.251851 Aug 29 20:12:56.656136 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 14/25] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:56 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:57.234883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:57.236024 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:57.268840 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:57.269807 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:57.274015 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:57.275778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:57.276645 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:57.280219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:57.346055 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:57.346730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:57.358163 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:57.358677 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:57.359193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:57.360005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:57.360472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:57.361618 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:57.507615 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:57.525583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7e60c0b1-3236-41df-9ca5-030f9ab81f95 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1295 microversion: 2.1 time: 0.180532 Aug 29 20:12:57.543417 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 15/26] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:57 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1295 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:57.677352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:57.678388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:57.698399 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:57.699376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:57.702653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:57.706300 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:57.707002 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:57.707580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:57.962559 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:57.975960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-051a7c0d-ca89-4d2b-9a75-15e80ba4db9b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1281 microversion: 2.1 time: 0.302895 Aug 29 20:12:57.985799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 16/27] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:57 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1281 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:58.550620 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:58.551404 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:58.563555 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:58.566476 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:58.572182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:58.580733 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:58.587316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:58.587316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:58.689746 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:58.707388 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-347ea834-fee1-45db-8f98-f55ef1adb02a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1273 microversion: 2.1 time: 1.476913 Aug 29 20:12:58.708583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 12/28] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:57 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1273 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:58.978510 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:58.989135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-42cf10c1-e84c-4e89-8d33-56f8304067b8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1295 microversion: 2.1 time: 0.442555 Aug 29 20:12:59.012455 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 17/29] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:58 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1295 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:59.017321 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:59.019646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:59.054974 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:59.058882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:59.059468 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:59.062550 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:59.064795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:59.068351 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:59.447582 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:12:59.459068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-df6e232d-9a3a-47dc-889a-8b45dcf75ed2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1279 microversion: 2.1 time: 0.461048 Aug 29 20:12:59.459947 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 13/30] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:58 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1279 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:12:59.742803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:12:59.743426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:12:59.756509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:59.757022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:59.757509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:59.758287 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:59.758824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:59.759231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:00.049799 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:00.051087 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:00.062211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:00.062716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:00.063233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:00.063863 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:00.064320 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:00.064743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:00.332393 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:00.359838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:00.383033 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-fb727dda-7089-4ad1-b019-1f3cb5887ee7 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.636078 Aug 29 20:13:00.394009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 18/31] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:12:59 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:00.486100 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:00.487569 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:00.502760 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:00.504246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:00.505600 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:00.507362 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:00.508355 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:00.509127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:00.704509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:00.719396 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-513b0ee0-6d9e-4742-aad3-02a87204e238 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1279 microversion: 2.1 time: 0.238987 Aug 29 20:13:00.721724 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 19/32] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:00 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1279 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:01.178534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:01.196453 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-21d632f9-d9c7-4a9c-b519-4769668ff4c2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1295 microversion: 2.1 time: 1.151466 Aug 29 20:13:01.197992 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 14/33] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:00 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1295 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:01.424021 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:01.425042 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:01.433073 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:01.433684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:01.434034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:01.434792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:01.435404 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:01.436099 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:01.746036 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:01.757821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:01.806734 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:01.807925 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:01.809558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:01.811768 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:01.812862 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:01.813869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:02.027849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:02.038071 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0c821a9f-fa3b-4525-b415-36be5db01697 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.619874 Aug 29 20:13:02.047086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 20/34] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:01 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:02.223958 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:02.225496 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:02.242187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:02.246939 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:02.248495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:02.249432 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:02.250058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:02.252519 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:02.340286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:02.356286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-445ddb23-a25c-49cf-b223-e84f7d32b6fd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1279 microversion: 2.1 time: 0.619941 Aug 29 20:13:02.363691 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 15/35] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:01 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1279 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:03.079930 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:03.080952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:03.088711 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:03.091381 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:03.096994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:03.098602 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:03.099579 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:03.100462 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:03.333277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:03.741389 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:03.755914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7e749c62-6cb1-436b-8fff-8511952a2fe5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 1.538073 Aug 29 20:13:03.756641 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 21/36] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:02 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:03.770517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:03.771698 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:03.792318 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:03.792822 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:03.793263 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:03.793996 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:03.795166 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:03.795864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:03.956838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=20 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:04.016744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:04.025995 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8684af99-643a-42c3-a450-61588bcb31a0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1279 microversion: 2.1 time: 0.266467 Aug 29 20:13:04.026583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 22/37] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:03 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:04.603179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:04.652969 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-65de2f5c-1f42-4637-a09c-8ca43654ec09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 1.572768 Aug 29 20:13:04.655664 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 16/38] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:03 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:04.780560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:04.782522 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:04.858464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:04.859744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:04.861862 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:04.865134 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:04.866027 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:04.868242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:05.055250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:05.056023 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:05.080727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:05.083181 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:05.086869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:05.087625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:05.088142 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:05.088571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:05.363305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=22 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:05.594571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:05.612964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4d0c6ebb-275a-4776-b38b-5087871b0040 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1279 microversion: 2.1 time: 0.559520 Aug 29 20:13:05.618600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 17/39] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:05 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1279 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:05.692217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:05.693915 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:05.718089 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:05.722193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:05.724121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:05.729594 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:05.730303 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:05.733615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:06.108946 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:06.117768 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-08232242-9ca2-440e-8f1d-a47b21d37969 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 1.344486 Aug 29 20:13:06.141548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 23/40] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:04 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:07.118975 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:07.128617 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cd8a4be3-13fc-45fc-a414-e39270849710 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 1.441866 Aug 29 20:13:07.131382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 18/41] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:05 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:07.137140 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:07.152751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:07.172239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:07.173009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:07.173605 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:07.174505 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:07.176279 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:07.176892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:07.474417 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-f9ea363e-1a85-4ded-9cec-2172d5a326a5 req-98084f96-5054-467c-aca3-64627e7e6e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904017b4-b4c2-4c74-915a-226fca8fff84", "tag": "0045d919-91d3-4f8b-af4a-a74b4dda9c57"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:07.510737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-f9ea363e-1a85-4ded-9cec-2172d5a326a5 req-98084f96-5054-467c-aca3-64627e7e6e31 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:07.511464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-f9ea363e-1a85-4ded-9cec-2172d5a326a5 req-98084f96-5054-467c-aca3-64627e7e6e31 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:07.512039 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-f9ea363e-1a85-4ded-9cec-2172d5a326a5 req-98084f96-5054-467c-aca3-64627e7e6e31 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:07.559596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-f9ea363e-1a85-4ded-9cec-2172d5a326a5 req-98084f96-5054-467c-aca3-64627e7e6e31 service nova] Creating event network-changed:0045d919-91d3-4f8b-af4a-a74b4dda9c57 for instance 904017b4-b4c2-4c74-915a-226fca8fff84 on hv-cinder-85426 Aug 29 20:13:07.565765 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-f9ea363e-1a85-4ded-9cec-2172d5a326a5 req-98084f96-5054-467c-aca3-64627e7e6e31 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 20:13:07.570478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-f9ea363e-1a85-4ded-9cec-2172d5a326a5 req-98084f96-5054-467c-aca3-64627e7e6e31 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 20:13:07.571887 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:07.572524 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:07.573097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:07.574004 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:07.574642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:07.577856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:07.602852 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.compute.rpcapi [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 20:13:07.609299 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] Releasing lock "compute-rpcapi-router" {{(pid=120787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 20:13:07.653307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2e14b1b2-af66-49f2-b9f5-575440ff6980 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.310122 Aug 29 20:13:07.656517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 24/42] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:07.675040 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:07.690678 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:07.706432 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:07.709476 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:07.711426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:07.716988 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:07.717904 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:07.720501 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:08.228022 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:08.239289 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-474f0083-18da-4126-8536-5a54f2c56d5e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 1.105909 Aug 29 20:13:08.245863 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 19/43] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:07 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:08.254939 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:08.255849 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:08.271539 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:08.275397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:08.278247 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:08.279952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:08.284051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:08.284585 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:08.394311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:08.434761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-67e1cfbe-0747-42f5-914d-2cc06a58f2ff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.768679 Aug 29 20:13:08.436956 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 25/44] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:07 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:09.287168 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:09.288687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:09.304572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:09.305409 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:09.306069 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:09.307723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:09.310436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:09.311040 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:09.696612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:09.708909 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1d5fecf1-c0ab-4d66-b194-042f8ed01007 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 1.461777 Aug 29 20:13:09.710060 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 20/45] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:08 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:09.716668 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:09.724582 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:09.750003 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:09.751936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:09.754384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:09.755446 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:09.756127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:09.757825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:09.906485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:09.933254 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cface7c6-a249-43b3-8fe3-52661267bbcd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.650664 Aug 29 20:13:09.984690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 26/46] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:09 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:10.707106 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-594105f3-eac8-4a93-b974-84cd34b1303f req-7754a0c4-516b-47ca-95cb-fc4643b0837e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "856657fa-097f-45c6-baeb-cc6a9d494a26", "tag": "2abb764e-7b21-4846-a0ae-4823b1e93dde"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:10.732478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-594105f3-eac8-4a93-b974-84cd34b1303f req-7754a0c4-516b-47ca-95cb-fc4643b0837e service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:10.732990 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-594105f3-eac8-4a93-b974-84cd34b1303f req-7754a0c4-516b-47ca-95cb-fc4643b0837e service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:10.734508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-594105f3-eac8-4a93-b974-84cd34b1303f req-7754a0c4-516b-47ca-95cb-fc4643b0837e service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:10.767797 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-594105f3-eac8-4a93-b974-84cd34b1303f req-7754a0c4-516b-47ca-95cb-fc4643b0837e service nova] Creating event network-changed:2abb764e-7b21-4846-a0ae-4823b1e93dde for instance 856657fa-097f-45c6-baeb-cc6a9d494a26 on hv-cinder-85426 Aug 29 20:13:10.785813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-594105f3-eac8-4a93-b974-84cd34b1303f req-7754a0c4-516b-47ca-95cb-fc4643b0837e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.798850 Aug 29 20:13:10.791492 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 27/47] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:10.800030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:10.800998 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:10.809696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:10.810260 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:10.810700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:10.811437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:10.812839 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:10.813384 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:10.895816 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:10.904870 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ceea106b-a781-4a05-b365-caa73254a34b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 1.193523 Aug 29 20:13:10.921880 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 21/48] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:09 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:10.995779 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:10.998226 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:11.010641 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:11.011141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:11.011723 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:11.013521 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:11.014347 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:11.014861 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:11.015089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:11.052885 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-38de56fa-10c2-432b-aec4-04e541dda531 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.248474 Aug 29 20:13:11.054057 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 28/49] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:10 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:11.358541 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:11.368994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f49aefb4-1052-4daf-982d-e52ffcce4cd0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.380578 Aug 29 20:13:11.370060 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 22/50] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:10 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:11.932306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:11.936723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:11.950135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:11.951756 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:11.956164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:11.962817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:11.963551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:11.965262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:11.977278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=100 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:12.077150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:12.077880 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:12.089277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:12.089968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:12.091281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:12.092300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:12.092952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:12.093580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:12.232838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:12.243360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f173e02c-e1d7-41a9-8880-145e3f1f10f2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.318360 Aug 29 20:13:12.255675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 29/51] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:11 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:12.287564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:12.304196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b21c57f9-3c96-4c0b-985a-67569a413aae tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.232444 Aug 29 20:13:12.305494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 23/52] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:12 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:12.403596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:12.404855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:12.411309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:12.411631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:12.412244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:12.413311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:12.413950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:12.414519 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:12.629189 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:12.642987 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bd861988-a5ee-4a4e-a5c7-01b56dce2205 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.243747 Aug 29 20:13:12.643868 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 30/53] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:12 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:12.828557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-d65927f3-55d3-448e-ab3a-b9def3ddb809 req-50909f08-ef85-48a4-8087-4341d0bad4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4067659-cb5f-422b-a547-f871635abe7a", "tag": "5a9c4a5b-6d99-489b-b1bc-edf1c4b8c63c"}, {"name": "network-changed", "server_uuid": "9e22a8cb-d313-4f23-81e1-304ce615af98", "tag": "176564cc-c512-416f-a721-31a4c9f05c08"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:12.852255 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d65927f3-55d3-448e-ab3a-b9def3ddb809 req-50909f08-ef85-48a4-8087-4341d0bad4cf service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:12.852622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d65927f3-55d3-448e-ab3a-b9def3ddb809 req-50909f08-ef85-48a4-8087-4341d0bad4cf service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:12.853286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d65927f3-55d3-448e-ab3a-b9def3ddb809 req-50909f08-ef85-48a4-8087-4341d0bad4cf service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:12.878121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-d65927f3-55d3-448e-ab3a-b9def3ddb809 req-50909f08-ef85-48a4-8087-4341d0bad4cf service nova] Creating event network-changed:5a9c4a5b-6d99-489b-b1bc-edf1c4b8c63c for instance e4067659-cb5f-422b-a547-f871635abe7a on hv-cinder-85426 Aug 29 20:13:12.878629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-d65927f3-55d3-448e-ab3a-b9def3ddb809 req-50909f08-ef85-48a4-8087-4341d0bad4cf service nova] Creating event network-changed:176564cc-c512-416f-a721-31a4c9f05c08 for instance 9e22a8cb-d313-4f23-81e1-304ce615af98 on hv-cinder-85426 Aug 29 20:13:12.880174 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d65927f3-55d3-448e-ab3a-b9def3ddb809 req-50909f08-ef85-48a4-8087-4341d0bad4cf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 20:13:12.880174 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d65927f3-55d3-448e-ab3a-b9def3ddb809 req-50909f08-ef85-48a4-8087-4341d0bad4cf service nova] Acquired lock "compute-rpcapi-router" {{(pid=120788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 20:13:12.881833 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:12.881833 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:12.881833 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:12.882827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:12.883458 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:12.895373 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:12.906988 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.compute.rpcapi [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 20:13:12.907982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] Releasing lock "compute-rpcapi-router" {{(pid=120788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 20:13:12.928291 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e37514ea-486a-4c14-af11-76a329375c30 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105652 Aug 29 20:13:12.929215 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 24/54] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:13:13.269558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:13.270242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:13.272759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:13.304131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:13.307314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:13.307931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:13.309689 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:13.313555 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:13.335535 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:13.340476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:13.356738 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:13.379547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:13.382229 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:13.385684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:13.391198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:13.391198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:13.391198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:13.599123 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:13.608659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ebb86f29-305e-44fa-80d7-34af01dca964 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.343035 Aug 29 20:13:13.622323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 31/55] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:13 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:13.667676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:13.668864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:13.676359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:13.676855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:13.677292 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:13.678126 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:13.678808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:13.679296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:13.704382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:13.713764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:13.727123 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e8c39469-8a63-4f56-85ee-758dfb42537f tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.398912 Aug 29 20:13:13.750133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 25/56] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:13 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:13.873002 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:13.882021 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2f5f3b6c-b497-459e-8777-a6bdca342df7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.219763 Aug 29 20:13:13.882607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 32/57] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:13 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:14.634171 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:14.636130 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:14.656262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:14.657138 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:14.657838 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:14.659663 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:14.661516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:14.663069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:14.772349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:14.773743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:14.801794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:14.803434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:14.803941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:14.806618 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:14.807105 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:14.807542 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:15.401844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:15.410514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c80360d7-6ae0-4818-b6a9-79b3544ceadf tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.644488 Aug 29 20:13:15.411305 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 33/58] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:14 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:15.416156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:15.417008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:15.427342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:15.427918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:15.428412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:15.429179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:15.429664 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:15.430119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:15.464305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:15.478262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f01a8853-2b9d-44fb-a9d3-93bb92287a9b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.852097 Aug 29 20:13:15.479751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 26/59] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:14 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:15.581727 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:15.589509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5a29ae2f-59ef-4857-9c02-dd76a6843b47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.176888 Aug 29 20:13:15.590117 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 34/60] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:15 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:16.439046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:16.439046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:16.439046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:16.439046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:16.439712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:16.439937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:16.440622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:16.441062 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:16.441473 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:16.499498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:16.500139 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:16.506205 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:16.506687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:16.507123 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:16.507815 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:16.508262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:16.508681 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:16.589481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:16.598273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a6add69f-4ece-4395-afb0-bb954c7a301a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.170703 Aug 29 20:13:16.598958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 27/61] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:16 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:16.610551 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:16.611264 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:16.617301 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:16.617805 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:16.618233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:16.618920 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:16.619365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:16.619777 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:16.647647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:16.656618 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bc8c5703-0fce-47b4-9fc5-b3f6b278708c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.160885 Aug 29 20:13:16.657205 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 35/62] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:16 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:16.753558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:16.761288 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7aa96238-5eda-47c9-b33f-346b3b3fa5c9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.154751 Aug 29 20:13:16.761893 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 28/63] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:16 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:17.619037 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:17.619648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:17.621528 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:17.627384 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:17.627878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:17.628316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:17.629022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:17.629475 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:17.629930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:17.677161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:17.677785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:17.684636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:17.685138 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:17.685573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:17.686333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:17.686784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:17.687207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:17.763460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:17.771851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2a651c18-fd96-4fa5-b152-7653730ddd7d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.156578 Aug 29 20:13:17.772439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 36/64] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:17 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:17.784015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:17.784806 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:17.791310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:17.791794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:17.792219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:17.792910 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:17.793358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:17.793811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:17.824230 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:17.840487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b3f35e33-ddf5-494a-a408-e2a24deece93 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.167106 Aug 29 20:13:17.841077 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 29/65] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:17 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:18.009898 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:18.022108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7068a1cd-e37d-41fc-91a0-cbed1f045f24 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.242218 Aug 29 20:13:18.022693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 37/66] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:17 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:18.794992 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:18.796145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:18.802630 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:18.803206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:18.803701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:18.804461 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:18.805029 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:18.806104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:18.925761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-ff53bc1f-81a3-4920-be99-88298aedec65 req-abc29bd9-306a-4639-96e1-fca7b169916f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904017b4-b4c2-4c74-915a-226fca8fff84", "name": "network-vif-plugged", "status": "completed", "tag": "0045d919-91d3-4f8b-af4a-a74b4dda9c57"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:18.937267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ff53bc1f-81a3-4920-be99-88298aedec65 req-abc29bd9-306a-4639-96e1-fca7b169916f service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:18.938002 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ff53bc1f-81a3-4920-be99-88298aedec65 req-abc29bd9-306a-4639-96e1-fca7b169916f service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:18.938437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ff53bc1f-81a3-4920-be99-88298aedec65 req-abc29bd9-306a-4639-96e1-fca7b169916f service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:18.951307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-ff53bc1f-81a3-4920-be99-88298aedec65 req-abc29bd9-306a-4639-96e1-fca7b169916f service nova] Creating event network-vif-plugged:0045d919-91d3-4f8b-af4a-a74b4dda9c57 for instance 904017b4-b4c2-4c74-915a-226fca8fff84 on hv-cinder-85426 Aug 29 20:13:18.956962 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-ff53bc1f-81a3-4920-be99-88298aedec65 req-abc29bd9-306a-4639-96e1-fca7b169916f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100338 Aug 29 20:13:18.957570 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 38/67] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:13:18.963098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:18.963798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:18.970253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:18.971092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:18.971584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:18.972305 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:18.972760 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:18.973179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:18.973402 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:18.981622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a99f4ac0-6918-42c9-94ee-f38c5efb49b8 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.191195 Aug 29 20:13:18.983025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 30/68] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:18 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:19.055786 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:19.056404 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:19.063200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:19.063682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:19.064122 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:19.064824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:19.065271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:19.065695 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:19.128832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:19.137605 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2507c8a1-ebf5-4c23-b347-ba0310fae73b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.178118 Aug 29 20:13:19.138268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 39/69] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:18 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:19.214672 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:19.224239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-da4bba0e-fa85-4bb2-b8ff-77fec3ce0584 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.172312 Aug 29 20:13:19.225761 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 31/70] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:19 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:20.004042 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:20.004609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:20.010806 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:20.011459 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:20.011894 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:20.012623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:20.013209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:20.014872 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:20.160878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:20.161556 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:20.166156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:20.169680 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:20.170201 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:20.170625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:20.171328 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:20.171782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:20.172214 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:20.179732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3b36b582-564d-439c-996c-82eaecbac941 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.179234 Aug 29 20:13:20.180623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 40/71] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:19 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:20.247500 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:20.248124 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:20.254469 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:20.254878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:20.255320 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:20.256021 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:20.256471 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:20.256897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:20.339020 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:20.352171 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1a578d32-896d-47cf-a027-3873bee2ca8a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.195381 Aug 29 20:13:20.352760 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 32/72] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:20 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:20.411590 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:20.419319 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8af2f1b5-d634-4ae3-acb2-fcc262cfd920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.175762 Aug 29 20:13:20.420381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 41/73] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:20 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:21.201373 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:21.201948 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:21.207885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:21.208358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:21.208778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:21.209456 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:21.209934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:21.210345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:21.346329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:21.358833 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0cf0a46b-e459-4b6c-a6c1-80c70cf6a745 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.161851 Aug 29 20:13:21.359468 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 33/74] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:21 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:21.377784 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:21.378445 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:21.385780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:21.386259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:21.386680 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:21.387367 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:21.387806 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:21.388876 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:21.443389 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:21.444005 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:21.451680 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:21.452096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:21.452525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:21.453218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:21.453668 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:21.454113 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:21.540478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:21.553073 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dc52600d-9779-4055-aa0c-152c9a7d03bc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.179044 Aug 29 20:13:21.557767 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 42/75] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:21 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:21.643945 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:21.657179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3383dfe3-ee4a-450f-a6cc-332e7cdd0834 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.217149 Aug 29 20:13:21.658213 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 34/76] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:21 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:22.380634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:22.381278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:22.387382 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:22.387879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:22.388569 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:22.389682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:22.390661 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:22.390661 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:22.582707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:22.583856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:22.593940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:22.595665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:22.596820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:22.597595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:22.598342 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:22.598942 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:22.599509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:22.606419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-12c06f1b-3c9f-4e71-8cf0-5b60a95c0492 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.230175 Aug 29 20:13:22.608190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 43/77] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:22 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:22.687078 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:22.687801 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:22.694368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:22.694919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:22.695428 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:22.696276 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:22.696788 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:22.697271 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:22.757325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:22.768012 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a1aba2aa-4cc6-415f-a2c0-2aac761fc2d8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.188699 Aug 29 20:13:22.768801 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 35/78] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:22 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:22.843371 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:22.851849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-350312be-8660-4bc2-a425-346f38907754 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.169286 Aug 29 20:13:22.852438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 44/79] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:22 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:23.631278 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:23.632165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:23.634025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:23.640332 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:23.640811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:23.641232 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:23.641952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:23.642397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:23.642811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:23.775916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:23.783958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6ab2c9b3-7b62-4f68-8998-fead6d96460d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.156423 Aug 29 20:13:23.784528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 36/80] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:23 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:23.789859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:23.790463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:23.796837 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:23.797316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:23.797757 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:23.798445 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:23.798891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:23.799302 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:23.873844 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:23.874682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:23.881330 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:23.881966 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:23.882554 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:23.883259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:23.883709 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:23.884127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:23.949107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:23.957486 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f1e15b17-11b5-4f28-a105-c86ccee5a899 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.171374 Aug 29 20:13:23.958089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 45/81] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:23 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:24.022292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:24.031088 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f6a3f58d-163d-4855-a6bc-25dcb2e493f8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.162197 Aug 29 20:13:24.031654 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 37/82] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:23 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:24.806130 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:24.806919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:24.814275 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:24.814869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:24.815412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:24.816242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:24.816745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:24.817256 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:24.844312 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=100 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:24.990948 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:24.991974 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:25.001343 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:25.002048 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:25.002711 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:25.003601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:25.004063 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:25.004489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:25.048188 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:25.060514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b1109745-595d-4a44-9af5-5fff669e5ce2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.258722 Aug 29 20:13:25.061296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 46/83] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:24 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:25.065957 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:25.066574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:25.073120 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:25.074270 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:25.075432 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:25.076978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:25.078070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:25.079068 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:25.249264 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:25.260203 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b12dfea3-9388-43de-99e2-fb3b89665a91 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.275641 Aug 29 20:13:25.262866 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 38/84] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:24 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:25.264144 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:25.275119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3b9bbd5c-8e36-4834-854b-0d91ac45bd0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.212457 Aug 29 20:13:25.276623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 47/85] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:25 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:26.092055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:26.095897 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:26.105520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:26.109030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:26.110000 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:26.111120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:26.111793 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:26.112487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:26.283709 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:26.284581 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:26.318345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:26.321644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:26.322848 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:26.325017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:26.327968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:26.328799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:26.631560 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:26.649146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8d689287-cee5-414a-8ba9-984807652fcd tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.561234 Aug 29 20:13:26.659467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 39/86] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:26 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:26.695782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:26.700498 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:26.702909 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:26.721132 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:26.723422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-67458a00-df14-42e2-9472-efd398846d5d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.441962 Aug 29 20:13:26.738212 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:26.738302 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 48/87] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:26 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:26.738372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:26.738372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:26.738372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:26.738372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:27.029187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:27.072175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ed84cb4c-9e81-4895-8f3d-f7df76952e58 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.410439 Aug 29 20:13:27.083758 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 40/88] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:26 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:27.666350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-00d8f13a-75bf-44be-8606-a55b3c24b937 req-ac1fece6-0177-4f3e-b359-9c2569c6e066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "856657fa-097f-45c6-baeb-cc6a9d494a26", "name": "network-vif-plugged", "status": "completed", "tag": "2abb764e-7b21-4846-a0ae-4823b1e93dde"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:27.687558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-00d8f13a-75bf-44be-8606-a55b3c24b937 req-ac1fece6-0177-4f3e-b359-9c2569c6e066 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:27.688924 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-00d8f13a-75bf-44be-8606-a55b3c24b937 req-ac1fece6-0177-4f3e-b359-9c2569c6e066 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:27.690294 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-00d8f13a-75bf-44be-8606-a55b3c24b937 req-ac1fece6-0177-4f3e-b359-9c2569c6e066 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:27.690640 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:27.691733 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:27.705370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:27.705898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:27.706517 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:27.708562 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:27.710357 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:27.710898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:27.723164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-00d8f13a-75bf-44be-8606-a55b3c24b937 req-ac1fece6-0177-4f3e-b359-9c2569c6e066 service nova] Creating event network-vif-plugged:2abb764e-7b21-4846-a0ae-4823b1e93dde for instance 856657fa-097f-45c6-baeb-cc6a9d494a26 on hv-cinder-85426 Aug 29 20:13:27.742457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-00d8f13a-75bf-44be-8606-a55b3c24b937 req-ac1fece6-0177-4f3e-b359-9c2569c6e066 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081417 Aug 29 20:13:27.745979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 49/89] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:27.759593 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:27.760928 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:27.774243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:27.775209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:27.776247 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:27.777570 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:27.779491 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:27.780741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:28.165757 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:28.179693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-263753a9-3370-47dc-a69a-6d00fa5b3272 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.431683 Aug 29 20:13:28.180971 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 50/90] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:27 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:28.188046 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:28.189047 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:28.197425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:28.198169 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:28.199369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:28.200436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:28.201388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:28.202525 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:28.509385 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:28.519193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:28.528566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c2229ee1-6aea-4127-acfa-8deb8a42ae53 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1315 microversion: 2.1 time: 0.851250 Aug 29 20:13:28.529991 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 41/91] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:27 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:28.536343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3fc8fbe9-098f-473b-b804-f2d29b55d318 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.353599 Aug 29 20:13:28.548922 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 51/92] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:28 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:29.207828 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:29.209156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:29.219197 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:29.220460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:29.221249 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:29.222684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:29.224509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:29.225311 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:29.261826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:29.469184 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:29.479145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e112b972-1a48-44f7-a8ea-c070539c662f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.278218 Aug 29 20:13:29.482289 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 42/93] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:29 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:29.556234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:29.557305 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:29.559228 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:29.561031 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:29.571175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:29.572379 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:29.573369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:29.574918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:29.577687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:29.579267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:29.581986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:29.582802 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:29.583529 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:29.585196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:29.586254 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:29.586913 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:29.864569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:29.867514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:29.884530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-249312ea-fe86-4c28-99b3-c4d46970b335 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1502 microversion: 2.1 time: 0.334615 Aug 29 20:13:29.885504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 52/94] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:29 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:29.892155 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-68159b61-9a24-4a29-a593-c7e9677f6f47 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.338524 Aug 29 20:13:29.892747 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 43/95] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:29 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:30.155835 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-a83bfd34-817b-4087-8aa0-c8d3eeb522d7 req-43b782be-4645-4abd-b55d-1e58954a3d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4067659-cb5f-422b-a547-f871635abe7a", "name": "network-vif-plugged", "status": "completed", "tag": "5a9c4a5b-6d99-489b-b1bc-edf1c4b8c63c"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:30.208095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a83bfd34-817b-4087-8aa0-c8d3eeb522d7 req-43b782be-4645-4abd-b55d-1e58954a3d0c service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:30.213549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a83bfd34-817b-4087-8aa0-c8d3eeb522d7 req-43b782be-4645-4abd-b55d-1e58954a3d0c service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:30.217474 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a83bfd34-817b-4087-8aa0-c8d3eeb522d7 req-43b782be-4645-4abd-b55d-1e58954a3d0c service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:30.271956 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-a83bfd34-817b-4087-8aa0-c8d3eeb522d7 req-43b782be-4645-4abd-b55d-1e58954a3d0c service nova] Creating event network-vif-plugged:5a9c4a5b-6d99-489b-b1bc-edf1c4b8c63c for instance e4067659-cb5f-422b-a547-f871635abe7a on hv-cinder-85426 Aug 29 20:13:30.288292 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-a83bfd34-817b-4087-8aa0-c8d3eeb522d7 req-43b782be-4645-4abd-b55d-1e58954a3d0c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139367 Aug 29 20:13:30.288973 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 53/96] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:30.511369 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:30.514368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:30.537110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:30.538457 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:30.539450 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:30.541166 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:30.542282 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:30.543738 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:30.959084 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:30.962190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:30.986182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:31.015117 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:31.015906 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:31.016615 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:31.023387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2c2ca17d-f46f-44a4-b44a-ea16be7e2259 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1362 microversion: 2.1 time: 0.520134 Aug 29 20:13:31.024399 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 44/97] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:30 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1362 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:31.039701 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:31.041258 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:31.043635 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:31.505093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:31.555492 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-51f02aed-3df9-4567-9bb9-81f9eb8ee059 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.616121 Aug 29 20:13:31.569423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 54/98] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:30 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:32.059492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:32.060425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:32.073662 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:32.076571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:32.078460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:32.080315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:32.081982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:32.130508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:32.296370 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fac149b-4bfb-49ee-9c26-8b128fcdb17c"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:32.300879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:32.315201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:32.316145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:32.316894 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:32.318464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:32.319309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:32.320141 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:32.779459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:32.800950 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2e809a63-fa6a-4668-a438-cbccb995eb5a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1546 microversion: 2.1 time: 0.747353 Aug 29 20:13:32.819268 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 45/99] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:32 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1546 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:32.841982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-aeef04fe-beac-450d-94f2-90d2a6423654 req-58d71583-778e-403a-856e-1761ef4e3b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e22a8cb-d313-4f23-81e1-304ce615af98", "name": "network-vif-plugged", "status": "completed", "tag": "176564cc-c512-416f-a721-31a4c9f05c08"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:32.879758 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-aeef04fe-beac-450d-94f2-90d2a6423654 req-58d71583-778e-403a-856e-1761ef4e3b49 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:32.880669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-aeef04fe-beac-450d-94f2-90d2a6423654 req-58d71583-778e-403a-856e-1761ef4e3b49 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:32.881735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-aeef04fe-beac-450d-94f2-90d2a6423654 req-58d71583-778e-403a-856e-1761ef4e3b49 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:32.909754 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-aeef04fe-beac-450d-94f2-90d2a6423654 req-58d71583-778e-403a-856e-1761ef4e3b49 service nova] Creating event network-vif-plugged:176564cc-c512-416f-a721-31a4c9f05c08 for instance 9e22a8cb-d313-4f23-81e1-304ce615af98 on hv-cinder-85426 Aug 29 20:13:32.927246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-aeef04fe-beac-450d-94f2-90d2a6423654 req-58d71583-778e-403a-856e-1761ef4e3b49 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105276 Aug 29 20:13:32.928527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 46/100] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:32.939148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:32.940789 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:32.953273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:32.954663 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:32.955858 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:32.957536 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:32.959555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:32.960349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:33.286682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:33.316542 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-76a32bf3-d03a-43c0-b462-7f4ffe550a09 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.383609 Aug 29 20:13:33.317826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 47/101] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:32 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:33.339401 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:33.340806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:33.361400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:33.362247 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:33.362989 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:33.364402 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:33.365578 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:33.366487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:33.681201 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-14e6a34d-c826-49d6-873b-99f9b1a6bc24 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.348431 Aug 29 20:13:33.682494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 48/102] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 29 20:13:33 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/os-interface => generated 284 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:34.115410 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-28bac607-a585-4c8a-bb76-c83608cf612e tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "POST /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.825537 Aug 29 20:13:34.117103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 55/103] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:13:32 2022] POST /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84/os-volume_attachments => generated 194 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:34.371153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:34.371915 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:34.383317 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:34.383729 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:34.384337 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:34.385066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:34.385525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:34.386040 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:34.666245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:34.678799 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3e222e47-ddb2-49d7-8b21-12f6526cfdb0 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.313367 Aug 29 20:13:34.690396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 49/104] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:34 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:35.705667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:35.706401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:35.718913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:35.719408 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:35.722438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:35.723661 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:35.724352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:35.724953 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:35.909895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-ce54180b-a6bb-49a2-b8ac-3d0a29fa5870 req-a4de75e4-d9cf-4d58-97a1-dfb7fe0a3017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "856657fa-097f-45c6-baeb-cc6a9d494a26", "tag": "2abb764e-7b21-4846-a0ae-4823b1e93dde"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:35.926745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-ce54180b-a6bb-49a2-b8ac-3d0a29fa5870 req-a4de75e4-d9cf-4d58-97a1-dfb7fe0a3017 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:35.927220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-ce54180b-a6bb-49a2-b8ac-3d0a29fa5870 req-a4de75e4-d9cf-4d58-97a1-dfb7fe0a3017 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:35.928032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-ce54180b-a6bb-49a2-b8ac-3d0a29fa5870 req-a4de75e4-d9cf-4d58-97a1-dfb7fe0a3017 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:35.947502 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-ce54180b-a6bb-49a2-b8ac-3d0a29fa5870 req-a4de75e4-d9cf-4d58-97a1-dfb7fe0a3017 service nova] Creating event network-changed:2abb764e-7b21-4846-a0ae-4823b1e93dde for instance 856657fa-097f-45c6-baeb-cc6a9d494a26 on hv-cinder-85426 Aug 29 20:13:35.949685 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:35.960956 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-ce54180b-a6bb-49a2-b8ac-3d0a29fa5870 req-a4de75e4-d9cf-4d58-97a1-dfb7fe0a3017 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054506 Aug 29 20:13:35.962781 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 50/105] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:13:35.972354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-98b21342-9d03-4db9-846f-95eb037f1347 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.271528 Aug 29 20:13:35.972938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 56/106] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:35 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:37.008718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:37.010325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:37.025995 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:37.031345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:37.032066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:37.034173 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:37.034845 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:37.035678 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:37.225829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:37.235242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-444141b3-40c2-4b19-8dc2-543aad35df36 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.231696 Aug 29 20:13:37.250760 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 51/107] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:37 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:38.262115 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:38.264121 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:38.277165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:38.278659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:38.280290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:38.283854 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:38.285259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:38.286639 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:38.548183 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:38.579208 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-47db3a83-1c22-4d5a-b3c4-982ecbd03110 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.324412 Aug 29 20:13:38.581504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 57/108] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:38 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:39.617826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:39.619530 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:39.635332 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:39.636558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:39.638033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:39.641512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:39.642196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:39.643021 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:40.121394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:40.130554 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b1b0d8c4-7e07-4263-8d05-1df565cf79bb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.516779 Aug 29 20:13:40.131659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 52/109] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:39 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:41.152599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:41.153394 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:41.166340 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:41.167675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:41.170131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:41.171454 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:41.171992 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:41.172930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:41.469460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:41.491183 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-34aaa512-ee56-4cb3-9bd2-2d4ac3ecc100 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1321 microversion: 2.1 time: 0.342003 Aug 29 20:13:41.493132 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 58/110] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:41 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:42.527123 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:42.527896 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:42.536041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:42.537019 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:42.537613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:42.538675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:42.539314 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:42.539883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:42.805808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:42.817963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-af16d703-1063-4c57-8b78-d2d49e16a49c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1516 microversion: 2.1 time: 0.296265 Aug 29 20:13:42.819362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 53/111] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:42 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1516 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:42.855630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:42.861381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:42.873355 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:42.874283 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:42.875301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:42.876873 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:42.877825 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:42.878792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:42.928522 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lazy-loading 'flavor' on Instance uuid 9e22a8cb-d313-4f23-81e1-304ce615af98 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:13:43.176689 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-be7eec29-4250-4656-a0f5-b329171bbd37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98/action" status: 200 len: 32 microversion: 2.1 time: 0.327720 Aug 29 20:13:43.180251 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 59/112] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:13:42 2022] POST /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98/action => generated 32 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:13:43.195052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:43.195972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:43.203688 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:43.204472 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:43.205086 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:43.206050 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:43.206685 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:43.207383 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:43.511377 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:43.532442 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5185a48c-66bd-42ad-aa49-e1899c0a339b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.341895 Aug 29 20:13:43.539860 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 54/113] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:43 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:44.558419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:44.560361 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:44.569667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=58 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:44.571578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:44.572304 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:44.572888 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:44.573932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:44.574535 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:44.574960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:44.740232 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:44.758145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c9b08c5e-6b46-42e2-b8cd-5171b0a42f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.203899 Aug 29 20:13:44.773161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 60/114] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:44 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:45.796723 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:45.797505 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:45.808057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:45.809812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:45.811182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:45.812392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:45.813371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:45.814192 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:46.043191 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:46.054388 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e8b19bec-a213-4162-b3db-67a2a805e7b8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.261954 Aug 29 20:13:46.055665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 55/115] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:45 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:47.096500 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:47.097826 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:47.111731 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:47.112905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:47.113968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:47.115616 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:47.116665 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:47.117698 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:47.166083 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:47.333614 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:47.349779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5c8c5e50-9f22-44f2-9882-aab6d6d8aedd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.260689 Aug 29 20:13:47.351811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 61/116] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:47 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:48.375629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:48.377994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:48.382727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=58 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:48.390615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:48.391846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:48.392621 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:48.393689 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:48.394358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:48.395045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:48.634581 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:48.644210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1bc7b9a5-89bc-4190-85c8-0c1b45630222 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.275640 Aug 29 20:13:48.644995 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 56/117] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:48 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:49.673769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:49.674899 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:49.690938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:49.692243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:49.693193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:49.694712 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:49.695492 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:49.696256 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:49.972761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:49.989210 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-25ded1c4-0768-4081-80f5-b8dffc633c78 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.320440 Aug 29 20:13:49.990330 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 62/118] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:49 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:51.012749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:51.014981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:51.021213 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:51.021927 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:51.022710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:51.023580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:51.024116 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:51.024620 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:51.239943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:51.248562 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f1b9f381-2c58-4819-83ef-d396dc210c64 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.239676 Aug 29 20:13:51.249154 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 57/119] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:51 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:13:52.275144 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:52.275903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:52.283012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:52.283447 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:52.283874 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:52.284557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:52.285025 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:52.285436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:52.439265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:52.447240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5c837a11-632a-47f0-96dc-efae3363860a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.176640 Aug 29 20:13:52.447830 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 63/120] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:52 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:53.469321 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:53.470023 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:53.477127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.477654 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.478169 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.478914 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.479492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.479951 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.642324 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:53.651253 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dfd55145-424c-4b2e-9871-e2cd79c78617 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.185953 Aug 29 20:13:53.652247 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 58/121] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:53 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:53.765258 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:53.766113 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:53.773052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.773587 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.774087 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.774971 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.775666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.776166 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.805533 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:13:53.913821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f3681b3d-ff8e-4616-9de6-21210628f3f4 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "DELETE /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 204 len: 0 microversion: 2.1 time: 0.152337 Aug 29 20:13:53.914695 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 64/122] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:13:53 2022] DELETE /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:13:53.925036 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:53.925898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:53.932289 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.932781 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.933238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.934047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.934470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.934889 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:54.100663 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:54.113815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-70a87336-ee17-4569-860b-a2e7f085122d tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.192342 Aug 29 20:13:54.114573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 59/123] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:53 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:54.699293 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:54.700489 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:54.710594 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:54.711274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:54.711881 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:54.712899 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:54.713520 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:54.714297 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:54.908641 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:54.919634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ebacfa69-35bd-4398-b822-d3c178b530b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.227949 Aug 29 20:13:54.920318 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 65/124] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:54 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:55.135981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:55.136686 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:55.144149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:55.144636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:55.145104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:55.145856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:55.146300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:55.146749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:55.314209 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:55.318263 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:55.325172 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-14a73cec-9101-48a1-abc3-6459e119fae2 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.192960 Aug 29 20:13:55.326779 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 60/125] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:55 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:55.947981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:55.948700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:55.957723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:55.958375 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:55.958690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:55.959818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:55.960153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:55.960605 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:56.192349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:56.202860 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9fa6f346-98fa-4c36-be28-f0c065529167 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.259343 Aug 29 20:13:56.203915 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 66/126] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:55 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:56.349796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:56.350973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:56.361895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:56.363084 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:56.364149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:56.366748 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:56.367480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:56.368859 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:56.587674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:56.598344 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-df735e58-337b-42ad-a47a-59894b1e87de tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.252674 Aug 29 20:13:56.599125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 61/127] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:56 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:57.227154 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:57.229005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:57.237445 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.237977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.238574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.239835 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.240127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.240782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.409975 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:57.423977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-413b421c-a9c4-421c-b9bc-ae853e6617b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.200650 Aug 29 20:13:57.424743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 67/128] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:57 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:57.622477 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:57.622477 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:57.632783 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.633581 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.634400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.635563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.636329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.637045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.845315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:57.860482 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5e485a9b-983c-455f-939c-52cf136b9c12 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.243137 Aug 29 20:13:57.861070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 62/129] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:57 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:58.449323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:58.450341 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:58.463800 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:58.464659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:58.465407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:58.466707 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:58.467540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:58.468284 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:58.651379 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:58.660944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ee1b9267-97ad-411d-8188-cbd213ea69be tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.218540 Aug 29 20:13:58.661864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 68/130] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:58 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:58.887919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:58.888851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:58.898743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:58.899392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:58.899926 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:58.900730 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:58.901378 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:58.901992 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:59.063060 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:59.071881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a3367e46-8491-4421-af08-f2f14f18d1a0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.190440 Aug 29 20:13:59.072662 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 63/131] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:58 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:59.692905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:59.693579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:59.701006 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:59.701580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:59.702244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:59.703512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:59.703971 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:59.704400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:59.881814 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:59.896537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3853b123-48a8-424b-b4d1-4c24cd6e4321 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.206882 Aug 29 20:13:59.907960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 69/132] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:13:59 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:00.097899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:00.098520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:00.105161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.105668 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.106144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.106901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.108075 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.108574 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.292515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:00.304933 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a88763c4-1e23-42ac-b565-f5f40af9fb64 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.211566 Aug 29 20:14:00.305916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 64/133] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:00 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:00.933972 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:00.934566 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:00.941735 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.942229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.942655 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.943367 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.943813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.944223 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:01.096614 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:01.105469 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e296b881-8e77-4ea4-a976-c86724abc17f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.175390 Aug 29 20:14:01.106214 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 70/134] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:00 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:01.333821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:01.334601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:01.343125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:01.343756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:01.344442 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:01.345348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:01.346195 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:01.346994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:01.542975 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:01.553362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-20acf8f8-4b05-421e-a2e0-79a6dfad22b5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.225265 Aug 29 20:14:01.553362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 65/135] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:01 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:02.131319 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:02.132415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:02.143062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.143552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.143987 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.144677 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.145110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.145507 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.303655 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:02.314257 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-55b141de-f0d1-4d7a-918a-54c2c8c0a7e6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.189721 Aug 29 20:14:02.314847 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 71/136] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:02 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:02.580138 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:02.580832 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:02.587119 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.587593 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.588018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.588703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.589145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.589612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.744576 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:02.753894 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7b40b3a1-2393-4f84-a215-88d278a2b87a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.178756 Aug 29 20:14:02.754622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 66/137] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:02 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:03.336933 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:03.337531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:03.344964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.345421 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.346109 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:03.346813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.347265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.347687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:03.523292 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:03.532202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5ea253c9-4650-40c0-8cf6-3fc20aab4fa2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.199630 Aug 29 20:14:03.532783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 72/138] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:03 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:03.778823 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:03.781906 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:03.788030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.788738 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.789160 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:03.789885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.790492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.791064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:04.068005 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:04.082253 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dc1d0109-afcf-4caf-bfd7-83f153afc6e9 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1554 microversion: 2.1 time: 0.309993 Aug 29 20:14:04.093743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 67/139] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:03 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1554 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:04.570534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:04.571157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:04.579897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:04.580477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:04.580842 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:04.581548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:04.587859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:04.588155 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:04.755832 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-95162180-1842-48ea-b62c-9940deda4c59 req-386f3236-f2a5-4225-8a44-d943e5fb0cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904017b4-b4c2-4c74-915a-226fca8fff84", "name": "network-vif-deleted", "tag": "0045d919-91d3-4f8b-af4a-a74b4dda9c57"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:04.773150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-95162180-1842-48ea-b62c-9940deda4c59 req-386f3236-f2a5-4225-8a44-d943e5fb0cd2 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:04.777431 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-95162180-1842-48ea-b62c-9940deda4c59 req-386f3236-f2a5-4225-8a44-d943e5fb0cd2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:04.779566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-95162180-1842-48ea-b62c-9940deda4c59 req-386f3236-f2a5-4225-8a44-d943e5fb0cd2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:04.826768 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-95162180-1842-48ea-b62c-9940deda4c59 req-386f3236-f2a5-4225-8a44-d943e5fb0cd2 service nova] Creating event network-vif-deleted:0045d919-91d3-4f8b-af4a-a74b4dda9c57 for instance 904017b4-b4c2-4c74-915a-226fca8fff84 on hv-cinder-85426 Aug 29 20:14:04.850892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-95162180-1842-48ea-b62c-9940deda4c59 req-386f3236-f2a5-4225-8a44-d943e5fb0cd2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102134 Aug 29 20:14:04.855682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 68/140] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:14:04.983035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:04.993542 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d510110d-a87a-4f61-b84c-18be0cb7feb1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.442940 Aug 29 20:14:04.994663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 73/141] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:04 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:05.110102 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:05.111199 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:05.119286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:05.119750 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:05.120173 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:05.121110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:05.122207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:05.123519 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:05.197278 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:05.206333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f4700b6a-be0a-4426-912e-c8d089892537 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1346 microversion: 2.1 time: 0.105045 Aug 29 20:14:05.207084 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 69/142] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:05 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:06.029406 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:06.035015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:06.054390 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.055015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.055683 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.056846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.057787 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.058662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.237339 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:06.240424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:06.261659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.262638 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.263587 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.265066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.265902 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.266558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.338257 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.339103 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.340116 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.341030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lazy-loading 'fault' on Instance uuid 904017b4-b4c2-4c74-915a-226fca8fff84 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:14:06.382892 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:06.410225 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d436aea7-f100-474a-9260-afbfb7ee4b48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.390156 Aug 29 20:14:06.441306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 74/143] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:06 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:06.470640 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:06.488238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-af1d86fa-1854-4280-8ff8-4f688705d56a tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1351 microversion: 2.1 time: 0.260649 Aug 29 20:14:06.489958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 70/144] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:06 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1351 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:07.448145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:07.448768 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:07.455748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.456244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.456678 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.457380 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.457867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.458289 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.523539 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:07.524271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:07.531098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.531590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.532013 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.532924 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.534364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.534364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.572578 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.573064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.573500 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.574017 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lazy-loading 'fault' on Instance uuid 904017b4-b4c2-4c74-915a-226fca8fff84 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:14:07.621937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:07.636460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:07.638048 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-64d68a1d-eef2-4236-93c4-7add98791f09 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1351 microversion: 2.1 time: 0.119151 Aug 29 20:14:07.638700 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 71/145] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:07 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:07.646481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-593d54c3-e6f9-4a0c-b66a-47abda064cfb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.202157 Aug 29 20:14:07.647299 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 75/146] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:07 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:08.671201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:08.672160 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:08.672323 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:08.672857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:08.679236 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.679708 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.679838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.680128 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.680498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.680820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.681048 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.681265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.681675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.682086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.682604 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.683093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.690017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:08.743881 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.744378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.744804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.745242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lazy-loading 'fault' on Instance uuid 904017b4-b4c2-4c74-915a-226fca8fff84 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:14:08.807696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:08.818284 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4479e7d9-7b6d-4229-a33d-f77207dda80c tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1351 microversion: 2.1 time: 0.151504 Aug 29 20:14:08.818965 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 76/147] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:08 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:08.874172 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:08.882707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8e02733f-c23e-4e0b-ae30-c0635e6d49b5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.216177 Aug 29 20:14:08.883310 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 72/148] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:08 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:09.860617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:09.861551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:09.892744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.892744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.893212 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.895052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.896822 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.899292 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.908322 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:09.911244 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:09.931030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.931523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.936096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.936924 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.938178 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.938942 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.955207 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.955702 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.956136 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.956592 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lazy-loading 'fault' on Instance uuid 904017b4-b4c2-4c74-915a-226fca8fff84 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:14:10.151540 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:10.165045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8e83f5c8-448d-44a0-bae2-f37df2b9f9c1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.263795 Aug 29 20:14:10.165687 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 73/149] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:09 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:10.223182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420a84d76e845c68bd14852b1a910a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcff03cfe90e4d1bb5f9bf1564edafa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:10.231120 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cd9237a3-dd8e-440e-8905-d67180b57292 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 200 len: 1305 microversion: 2.1 time: 0.385080 Aug 29 20:14:10.231714 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 77/150] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:09 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 1305 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:11.192901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:11.194030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:11.207286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.208220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.208979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.210488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.211319 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.212072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.261524 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:11.262929 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:11.274076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.274302 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.274667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.275373 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.276252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.276701 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.312395 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] HTTP exception thrown: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Request method failure captured: Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 HTTP/1.1 Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR2-RF_EXgTSeWytlNVP8wlhLpvEZ40ZXtau3EAqMVDAaNJgJSjypRPngyRd2CT_a42YAXclKRPVWJRG7Zrb53U3rrBj4VJ-gBCcGciwY4WVibh26nM1EXFEArmdokbUZk08ugpFI7RW8DI2NbF5h49qv_KDAPAFKLKqAIHxKrQokWU Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: bcff03cfe90e4d1bb5f9bf1564edafa6 Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:14:11.322798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}] Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: bcff03cfe90e4d1bb5f9bf1564edafa6 Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-DeleteServersTestJSON-349754354-project Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 2420a84d76e845c68bd14852b1a910a9 Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-DeleteServersTestJSON-349754354-project Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.324272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '904017b4-b4c2-4c74-915a-226fca8fff84'} Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:14:11.325030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.326309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.329471 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Returning 404 to user: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:14:11.332354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dae495de-9828-418d-a181-4b8fca782d02 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 404 len: 111 microversion: 2.1 time: 0.074218 Aug 29 20:14:11.333648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 78/151] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:11 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:14:11.423172 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:11.440196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-125b6881-f3df-4ae0-bb07-924b18dee54e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.251346 Aug 29 20:14:11.440862 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 74/152] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:11 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:11.567819 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:11.572361 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:11.583468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.584263 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.584950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.586211 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.587353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.588236 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.614913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] HTTP exception thrown: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Request method failure captured: Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84/os-volume_attachments HTTP/1.1 Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR2-RF_EXgTSeWytlNVP8wlhLpvEZ40ZXtau3EAqMVDAaNJgJSjypRPngyRd2CT_a42YAXclKRPVWJRG7Zrb53U3rrBj4VJ-gBCcGciwY4WVibh26nM1EXFEArmdokbUZk08ugpFI7RW8DI2NbF5h49qv_KDAPAFKLKqAIHxKrQokWU Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: bcff03cfe90e4d1bb5f9bf1564edafa6 Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:14:11.617810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}] Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: bcff03cfe90e4d1bb5f9bf1564edafa6 Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-DeleteServersTestJSON-349754354-project Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 2420a84d76e845c68bd14852b1a910a9 Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-DeleteServersTestJSON-349754354-project Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.619234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'server_id': '904017b4-b4c2-4c74-915a-226fca8fff84'} Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:14:11.619921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:11.621202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:11.622714 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Returning 404 to user: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:14:11.622714 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-937b6438-6b70-405e-a918-bfe7e7d50af0 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061029 Aug 29 20:14:11.622714 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 79/153] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:14:11 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:14:12.462271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:12.467737 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:12.476954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:12.478065 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:12.479703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.481130 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:12.482106 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:12.486815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.675218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:12.684584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b5c39e04-ab27-45bc-9f88-66b13989e0dd tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.226497 Aug 29 20:14:12.685597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 75/154] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:12 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:13.707609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:13.708272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:13.717381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.717381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.717381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.717381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.717759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.718106 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.867831 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:13.877766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-24c6c011-9165-486a-9da2-6fb19846c98c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.174088 Aug 29 20:14:13.878338 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 80/155] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:13 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:14.902712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:14.903749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:14.910821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.911312 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.911778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:14.912448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.912905 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.913327 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:15.116309 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:15.127929 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a5889ca8-0086-47ac-a74f-c1a64c6d93de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.230815 Aug 29 20:14:15.128654 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 76/156] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:14 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:16.154906 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:16.155506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:16.157677 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:16.164997 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:16.166259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:16.167268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:16.168556 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:16.169018 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:16.169644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:16.315349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:16.323374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bbbed3e2-03c6-48a7-b166-396be028fcc8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.173785 Aug 29 20:14:16.323957 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 81/157] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:16 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:17.345182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:17.345804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:17.351973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.352446 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.352872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.353578 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.354028 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.354442 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.374848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:17.528182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:17.542125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d91015a7-a69d-45ee-aecd-64added7d07d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.200673 Aug 29 20:14:17.542997 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 77/158] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:17 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:18.565380 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:18.566016 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:18.573042 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:18.573521 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:18.574006 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:18.574706 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:18.575159 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:18.575592 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:18.742278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:18.752192 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e3c379b1-5114-4d9c-bca5-d142b90d4046 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.190905 Aug 29 20:14:18.752787 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 82/159] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:18 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:19.380255 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:19.381328 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:19.384501 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=48 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:19.401770 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.402749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.403528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.405952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.406674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.407165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.426294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] HTTP exception thrown: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Request method failure captured: Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 HTTP/1.1 Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR2-RF_EXgTSeWytlNVP8wlhLpvEZ40ZXtau3EAqMVDAaNJgJSjypRPngyRd2CT_a42YAXclKRPVWJRG7Zrb53U3rrBj4VJ-gBCcGciwY4WVibh26nM1EXFEArmdokbUZk08ugpFI7RW8DI2NbF5h49qv_KDAPAFKLKqAIHxKrQokWU Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: bcff03cfe90e4d1bb5f9bf1564edafa6 Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:14:19.431464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}] Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: bcff03cfe90e4d1bb5f9bf1564edafa6 Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-DeleteServersTestJSON-349754354-project Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 2420a84d76e845c68bd14852b1a910a9 Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-DeleteServersTestJSON-349754354-project Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.433857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '904017b4-b4c2-4c74-915a-226fca8fff84'} Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:14:19.435259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.439847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.444443 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Returning 404 to user: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:14:19.444443 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-02d3299e-5d9f-4589-907c-036d121be903 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "DELETE /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 404 len: 111 microversion: 2.1 time: 0.069699 Aug 29 20:14:19.444443 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 78/160] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:14:19 2022] DELETE /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:14:19.448898 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:19.450041 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] [instance: 904017b4-b4c2-4c74-915a-226fca8fff84] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:19.460901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.461957 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.462765 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.463638 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.464320 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.465022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.492703 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] HTTP exception thrown: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Request method failure captured: Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 HTTP/1.1 Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR2-RF_EXgTSeWytlNVP8wlhLpvEZ40ZXtau3EAqMVDAaNJgJSjypRPngyRd2CT_a42YAXclKRPVWJRG7Zrb53U3rrBj4VJ-gBCcGciwY4WVibh26nM1EXFEArmdokbUZk08ugpFI7RW8DI2NbF5h49qv_KDAPAFKLKqAIHxKrQokWU Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: bcff03cfe90e4d1bb5f9bf1564edafa6 Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:14:19.496201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bcff03cfe90e4d1bb5f9bf1564edafa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bcff03cfe90e4d1bb5f9bf1564edafa6"}]}] Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: bcff03cfe90e4d1bb5f9bf1564edafa6 Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-DeleteServersTestJSON-349754354 Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-DeleteServersTestJSON-349754354-project Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 2420a84d76e845c68bd14852b1a910a9 Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-DeleteServersTestJSON-349754354-project Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.499052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '904017b4-b4c2-4c74-915a-226fca8fff84'} Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:14:19.500775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. Aug 29 20:14:19.504081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:19.508666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] Returning 404 to user: Instance 904017b4-b4c2-4c74-915a-226fca8fff84 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:14:19.508666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5801e165-65e5-4855-b60a-fc6f0ee4c2e5 tempest-DeleteServersTestJSON-349754354 tempest-DeleteServersTestJSON-349754354-project] 10.222.0.73 "GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84" status: 404 len: 111 microversion: 2.1 time: 0.057115 Aug 29 20:14:19.508666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 83/161] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:19 2022] GET /compute/v2.1/servers/904017b4-b4c2-4c74-915a-226fca8fff84 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:14:19.776375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:19.776981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:19.785464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.785982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.786402 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.787114 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.787553 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.787962 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:20.126196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:20.135747 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8f7b469e-4b58-415d-8787-b832f23976d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1522 microversion: 2.1 time: 0.363789 Aug 29 20:14:20.136500 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 79/162] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:19 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:21.190663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:21.196928 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:21.215048 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.219097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.224586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.227239 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.228556 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.230683 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.639926 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:21.652341 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bfcbbc2c-02dd-4eaf-b6f6-d1fefa0df861 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1502 microversion: 2.1 time: 0.495896 Aug 29 20:14:21.655658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 84/163] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:21 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1502 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:21.679233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:21.680369 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:21.690289 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.690743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.691342 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.692140 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.692568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.693386 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:22.281281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:22.290693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-daf907be-1f26-4d81-80d9-8310f25a0062 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1517 microversion: 2.1 time: 0.616348 Aug 29 20:14:22.291743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 80/164] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:21 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1517 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:26.334552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:26.346891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:26.360048 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.361180 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.362201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.363437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.364202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.364931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.399904 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lazy-loading 'flavor' on Instance uuid e4067659-cb5f-422b-a547-f871635abe7a {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:14:26.609311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9340e115-1d9b-4f39-ab6c-a36ffccfcbd7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a/action" status: 200 len: 32 microversion: 2.1 time: 0.278979 Aug 29 20:14:26.610555 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 85/165] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:14:26 2022] POST /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:14:26.637049 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:26.640820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:26.662249 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.662829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.663318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.664610 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.665948 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.666901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:27.183555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:27.212296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-42426df1-7485-434b-aa72-e60923254937 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.591966 Aug 29 20:14:27.213218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 81/166] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:26 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:28.239648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:28.240351 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:28.263391 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.267063 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.268090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.268990 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.270578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.271192 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.585968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:28.601001 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-16299401-4d1a-45b1-af73-83251ee524df tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.369471 Aug 29 20:14:28.602537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 86/167] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:28 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:29.627072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:29.628340 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:29.635759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:29.636797 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:29.637578 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:29.638461 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:29.639163 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:29.640424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:29.852870 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:29.862306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13b79d7c-13df-4c05-951d-fdcd21c84db9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.239863 Aug 29 20:14:29.876481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 82/168] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:29 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:30.885881 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:30.886680 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:30.900724 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:30.901539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:30.902239 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:30.903153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:30.904269 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:30.905563 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.117084 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:31.126998 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f692cb11-02ff-44b3-b515-c90e4fa95bae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.246802 Aug 29 20:14:31.127911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 87/169] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:30 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:32.156663 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:32.157959 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:32.165098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:32.166129 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:32.167112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:32.168008 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:32.169090 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:32.170483 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:32.489052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:32.509482 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a3ebfd56-1e1c-4d61-84a8-14803e6284fb tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.357013 Aug 29 20:14:32.525959 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 83/170] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:32 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:33.544846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:33.545752 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:33.560734 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.561300 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.561832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.562788 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.563315 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.563964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.824172 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:33.859429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ecbe55f2-50a4-4038-b5d7-1022933ae5f4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.314884 Aug 29 20:14:33.860663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 88/171] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:33 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:34.071872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2c19016b-0d77-4094-9df7-2559bebeaf46 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'create', calling method: .version_select at 0x7f15fa057dc0>, body: {"keypair": {"name": "tempest-keypair-659995797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkMMt/mqsO6ajrdfxq9ghJj0L2A8z/k7K7A6k8gkImT8HPGqvUVoGnwVc+zy1hZjhYV01vj8EUbq16Rv3ZAwHowoyYg5PKZgY9UK3zS/B02eR/mwXBcaNmalRor1/FPjg=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:34.102822 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-2c19016b-0d77-4094-9df7-2559bebeaf46 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Getting quotas for project fc733dcfcf9043feb354598fc2792ff5. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:14:34.108687 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-2c19016b-0d77-4094-9df7-2559bebeaf46 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Getting quotas for user 1ffc617c50984f83adc3269b118c8a91 and project fc733dcfcf9043feb354598fc2792ff5. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:14:34.160377 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2c19016b-0d77-4094-9df7-2559bebeaf46 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.334247 Aug 29 20:14:34.165655 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 84/172] 10.222.0.73 () {62 vars in 1200 bytes} [Mon Aug 29 20:14:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 337 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 20:14:34.921134 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:34.928676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:34.940779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.941654 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.942406 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:34.943806 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.944584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.945270 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.240854 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:35.256947 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3a85e752-622a-4eb8-950b-e97d26c3601e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.340903 Aug 29 20:14:35.273343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 89/173] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:34 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:35.851543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1549271932", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "networks": [{"uuid": "792ae931-1d50-478f-bb03-d694cbfc32a6"}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:35.977561 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] validate_networks() for [('792ae931-1d50-478f-bb03-d694cbfc32a6', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:14:36.286568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:36.287397 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:36.297692 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.298309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.298778 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.299810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.300309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.300761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.594370 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:36.606963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5a4cb8bf-06bf-4c45-837a-632b3c601463 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.327950 Aug 29 20:14:36.608937 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 90/174] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:36 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:36.867535 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1615451534", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0d72436-11cb-4b65-af1f-b46234f8df90"}], "security_groups": [{"name": "tempest-securitygroup--718031106"}], "key_name": "tempest-keypair-659995797", "user_data": "}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:37.097927 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:14:37.098756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:14:37.099391 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:14:37.100222 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:14:37.101150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:14:37.140523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:37.144390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:37.145461 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:37.148708 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:37.151689 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:37.154683 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:37.235712 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] validate_networks() for [('f0d72436-11cb-4b65-af1f-b46234f8df90', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:14:37.253292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Getting quotas for project 95b900960ce84ebba14e9157e030287e. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:14:37.275064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Getting quotas for user be17fa7c5ebe49efa4bcae7c721a5e01 and project 95b900960ce84ebba14e9157e030287e. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:14:37.324505 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:14:37.334080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:14:37.541675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eac25354-6215-4d71-899a-5923e194363e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695819 Aug 29 20:14:37.545585 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 85/175] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:14:37.570358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9d778fbd-0462-4f9d-af6b-c730b5c4e174 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:37.571665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9d778fbd-0462-4f9d-af6b-c730b5c4e174 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:37.814864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9d778fbd-0462-4f9d-af6b-c730b5c4e174 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:37.825156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9d778fbd-0462-4f9d-af6b-c730b5c4e174 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1214 microversion: 2.1 time: 0.266256 Aug 29 20:14:37.838394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 86/176] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:37 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1214 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:37.853067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:37.866751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:37.885149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:37.886739 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:37.887484 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:37.888350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:37.889158 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:37.889848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.465636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:14:38.468572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:14:38.468572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:14:38.468572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:14:38.468572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:14:38.478467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.487897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.491767 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.492818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.495818 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0f09e3b2-82cb-41dc-990f-65d179239920 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.664324 Aug 29 20:14:38.496870 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 87/177] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:37 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:38.497637 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.500320 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.501037 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.564153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Getting quotas for project fc733dcfcf9043feb354598fc2792ff5. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:14:38.577020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Getting quotas for user 1ffc617c50984f83adc3269b118c8a91 and project fc733dcfcf9043feb354598fc2792ff5. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:14:38.594356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:14:38.597544 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:14:38.727222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-24b7db2d-9c4f-4fbd-b63d-d00287ed7b80 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.882589 Aug 29 20:14:38.733820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 91/178] 10.222.0.73 () {62 vars in 1188 bytes} [Mon Aug 29 20:14:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 20:14:38.755658 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9969c860-c8a7-410e-a3b4-d9e5ffc63b43 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:38.756658 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9969c860-c8a7-410e-a3b4-d9e5ffc63b43 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:38.869808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:38.874942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:38.887369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.888249 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.889515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.892787 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.893740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.894451 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.902657 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:38.927466 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9969c860-c8a7-410e-a3b4-d9e5ffc63b43 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.949808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9969c860-c8a7-410e-a3b4-d9e5ffc63b43 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.951941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9969c860-c8a7-410e-a3b4-d9e5ffc63b43 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.953095 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9969c860-c8a7-410e-a3b4-d9e5ffc63b43 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1281 microversion: 2.20 time: 0.204249 Aug 29 20:14:38.969207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 88/179] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:38 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:39.146794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:39.180052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e6ac5843-f13a-44e2-9587-2954b34f285f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1218 microversion: 2.1 time: 0.319358 Aug 29 20:14:39.182834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 92/180] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:38 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1218 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:39.538000 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:39.539555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:39.550493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:39.556074 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:39.556546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:39.557828 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:39.557828 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:39.558144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:39.987508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:39.988493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:40.027491 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:40.030154 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:40.032807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.034202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:40.034947 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:40.040696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.103416 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.125409 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9c11696e-de6c-4841-90a7-e035564a5228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.592342 Aug 29 20:14:40.127538 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 89/181] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:39 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:40.209110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:40.210246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:40.218871 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.228972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:40.228972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:40.228972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.228972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:40.229408 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:40.229408 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.235564 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.237317 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.238478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6c4b626b-40b6-46a1-98a7-a3cb19fef5c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1277 microversion: 2.20 time: 0.263356 Aug 29 20:14:40.239026 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 93/182] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:39 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:40.328607 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.341671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dd046d23-59f6-412d-9a6c-5498b1756e9a tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1266 microversion: 2.1 time: 0.141353 Aug 29 20:14:40.344294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 90/183] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:40 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:41.163288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:41.163906 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:41.193011 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.193849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.194611 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.195403 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.195858 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.196279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.273990 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:41.277587 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:41.319759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.322726 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.328775 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.334077 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.334681 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.335131 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.519160 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:41.534372 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c719d36f-6e7a-4efb-ba40-e32b3cb1d7de tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.375111 Aug 29 20:14:41.547806 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 94/184] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:41 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:41.554960 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:41.556011 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:41.556808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:41.566351 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.567299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:41.568607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.568735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:41.569321 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.569878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-45643064-2775-449b-b800-51b8ea2e1e45 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1333 microversion: 2.20 time: 0.304794 Aug 29 20:14:41.570780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.571405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.572245 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.576416 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 91/185] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:41 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1333 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:41.706828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:41.712423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dccaf3a3-172a-4f89-a427-505554642b36 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1272 microversion: 2.1 time: 0.162623 Aug 29 20:14:41.713477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 95/186] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:41 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:42.570215 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:42.571249 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:42.579116 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.579652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.580198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.580977 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.581498 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.582033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.616673 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:42.617693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:42.628531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.629608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.630306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.631031 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.631802 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.632612 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.737201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:42.748660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:42.750319 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:42.751486 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1f58bf83-11c1-4769-b782-9b56266a0df9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1333 microversion: 2.20 time: 0.141686 Aug 29 20:14:42.757127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 96/187] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:42 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1333 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:42.766792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:42.767684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:42.777105 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.778097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.781205 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.783958 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.784540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.784981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.991070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:43.012512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cd5c11a1-35a7-40f5-a6da-5e83599c82f5 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.437998 Aug 29 20:14:43.013520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 92/188] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:42 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:43.110936 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:43.121584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9b4c8c01-5318-41ca-85d0-426e7d6ac9c2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.367187 Aug 29 20:14:43.138733 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 97/189] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:42 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:43.790379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:43.791396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:43.802698 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:43.806249 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:43.806708 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:43.808661 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:43.809155 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:43.810958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:43.987266 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:43.999916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:44.002499 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:44.004572 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c0e99c0d-8568-4695-86a2-ad4593309449 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1339 microversion: 2.20 time: 0.220858 Aug 29 20:14:44.005657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 93/190] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:43 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:44.049747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:44.055408 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:44.067029 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.067790 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.068306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.069090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.070098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.071117 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.153976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:44.154877 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:44.177662 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.178444 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.181438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.182358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.182911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.183572 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.425826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:44.435526 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5762ec42-2c21-4350-b22a-46fbe825a79c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.285597 Aug 29 20:14:44.436809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 94/191] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:44 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:44.442694 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-20cfd198-651e-4454-a45f-bc72c5e6d9d4 req-c1a81894-4a2d-464e-9577-5b4356839a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe876d16-ee3b-4423-bc61-402c07105d0d", "tag": "80eb06c7-bb62-4e58-b85c-9fc9ea7efddf"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:44.457096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-20cfd198-651e-4454-a45f-bc72c5e6d9d4 req-c1a81894-4a2d-464e-9577-5b4356839a46 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.458336 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-20cfd198-651e-4454-a45f-bc72c5e6d9d4 req-c1a81894-4a2d-464e-9577-5b4356839a46 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.459276 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-20cfd198-651e-4454-a45f-bc72c5e6d9d4 req-c1a81894-4a2d-464e-9577-5b4356839a46 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.489780 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-20cfd198-651e-4454-a45f-bc72c5e6d9d4 req-c1a81894-4a2d-464e-9577-5b4356839a46 service nova] Creating event network-changed:80eb06c7-bb62-4e58-b85c-9fc9ea7efddf for instance fe876d16-ee3b-4423-bc61-402c07105d0d on hv-cinder-85426 Aug 29 20:14:44.497670 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-20cfd198-651e-4454-a45f-bc72c5e6d9d4 req-c1a81894-4a2d-464e-9577-5b4356839a46 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059167 Aug 29 20:14:44.499118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 95/192] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:44.750909 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:44.761284 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a202a1cb-06d5-4470-84ad-af56f1aa5955 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.721678 Aug 29 20:14:44.762247 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 98/193] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:44 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:45.047648 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:45.048349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:45.059548 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.061125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.062266 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:45.065044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.065973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.066990 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:45.191459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:45.221973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:45.226391 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:45.229118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-599d420f-13b5-4220-abc3-556b91ef65e3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1339 microversion: 2.20 time: 0.185656 Aug 29 20:14:45.242950 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 96/194] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:45 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:45.474297 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:45.476287 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:45.495419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.496934 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.497862 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:45.500036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.501151 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.501858 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:45.718457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:45.731434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d94996fb-eaa2-43c1-bed6-40d325008e0d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.264590 Aug 29 20:14:45.731434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 99/195] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:45 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:45.801652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:45.802850 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:45.823599 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.824579 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.825851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:45.828922 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.830076 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.831011 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.139459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:46.171016 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eca5272b-540c-4f07-a75d-ca96a87b380b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1503 microversion: 2.1 time: 0.378678 Aug 29 20:14:46.171999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 97/196] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:45 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:46.217827 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a678c1b-c074-47ce-8799-c5f5a31d6f8a"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:46.222811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:46.225893 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:46.238493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.239106 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.239640 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.240854 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.241444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.243074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.273568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:46.274712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:46.293193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] HTTP exception thrown: Cannot 'attach_volume' instance e4067659-cb5f-422b-a547-f871635abe7a while it is in vm_state rescued Aug 29 20:14:46.296204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.297040 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Request method failure captured: Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: POST /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a/os-volume_attachments HTTP/1.1 Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 74 Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR28w0cdbqbjUs7cPGu7Z3OpjfbycPDV81CmrJ2VVTtylWpySvnPIB1VScYNDbHLRzClVx9T9FNVGLsetYZRxK-OeEFHX2UT0dVXCTtnV8PQta4BG_v1Chna25Ls1ii1hIZxIMuA3GvqvqMgjb8d0H4ctp2OnlDzQgoj8Uo1iZRI7O8 Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:14:46.297744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bbb0263903e14938b44d9a6b430d84ce"}]}] Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: e75b537d44524de192282b10825293f9 Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {"volumeAttachment": {"volumeId": "2a678c1b-c074-47ce-8799-c5f5a31d6f8a"}} Aug 29 20:14:46.299049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Cannot 'attach_volume' instance e4067659-cb5f-422b-a547-f871635abe7a while it is in vm_state rescued Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'server_id': 'e4067659-cb5f-422b-a547-f871635abe7a', 'body': {'volumeAttachment': {'volumeId': '2a678c1b-c074-47ce-8799-c5f5a31d6f8a'}}} Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e4067659-cb5f-422b-a547-f871635abe7a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:14:46.299851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e4067659-cb5f-422b-a547-f871635abe7a while it is in vm_state rescued Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:14:46.301010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:14:46.302175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:14:46.302175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:14:46.302175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e4067659-cb5f-422b-a547-f871635abe7a while it is in vm_state rescued Aug 29 20:14:46.302175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:14:46.302427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.302427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.302427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.302427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.304709 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Returning 409 to user: Cannot 'attach_volume' instance e4067659-cb5f-422b-a547-f871635abe7a while it is in vm_state rescued {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:14:46.307921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0ec5dd0c-fcb0-4dd5-8a46-d322c78d1c9d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.113914 Aug 29 20:14:46.311197 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 100/197] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:14:46 2022] POST /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a/os-volume_attachments => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:14:46.344219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:46.345476 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:46.359734 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.362053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.363249 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.364741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.366923 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.370137 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.543457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-02253f65-f495-458e-b500-8d2597fe42d8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a/action" status: 202 len: 0 microversion: 2.1 time: 0.217595 Aug 29 20:14:46.551393 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 101/198] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:14:46 2022] POST /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:14:46.576963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:46.577866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:46.596340 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.596872 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.597318 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.598062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.602639 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.603729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:47.005673 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:47.023735 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-04bbdeb6-3477-4ed1-9f63-2249f8c8969c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1511 microversion: 2.1 time: 0.465947 Aug 29 20:14:47.025890 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 102/199] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:46 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:47.034854 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:47.036909 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:47.047022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:47.048121 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:47.048791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:47.049675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:47.050741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:47.051325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:47.180014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:47.201170 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:47.203329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:47.205097 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3587e578-120d-49de-9ca6-7313a80c7eec tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1406 microversion: 2.20 time: 0.939752 Aug 29 20:14:47.206044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 98/200] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:46 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1406 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:47.636145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:47.658004 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0f8337dd-7133-4c48-ae2a-a89ead5ff4b3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.630216 Aug 29 20:14:47.658918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 103/201] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:47 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:47.815797 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-d7d8b80f-b2fd-43c5-9917-86ae1ff5581c req-80fd5f75-49d6-443c-b34a-7b1755f6e8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86403f3-4482-4e27-9f97-cdf8fc2dd9ad", "tag": "4c3e0080-8d58-44c1-8b13-e2b6f6549e47"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:47.823316 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:47.832312 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d7d8b80f-b2fd-43c5-9917-86ae1ff5581c req-80fd5f75-49d6-443c-b34a-7b1755f6e8f5 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:47.836385 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d7d8b80f-b2fd-43c5-9917-86ae1ff5581c req-80fd5f75-49d6-443c-b34a-7b1755f6e8f5 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:47.837293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d7d8b80f-b2fd-43c5-9917-86ae1ff5581c req-80fd5f75-49d6-443c-b34a-7b1755f6e8f5 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:47.856606 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=99 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:47.862406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-d7d8b80f-b2fd-43c5-9917-86ae1ff5581c req-80fd5f75-49d6-443c-b34a-7b1755f6e8f5 service nova] Creating event network-changed:4c3e0080-8d58-44c1-8b13-e2b6f6549e47 for instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad on hv-cinder-85426 Aug 29 20:14:47.874381 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-d7d8b80f-b2fd-43c5-9917-86ae1ff5581c req-80fd5f75-49d6-443c-b34a-7b1755f6e8f5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062109 Aug 29 20:14:47.877574 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 99/202] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:14:48.064116 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:48.064983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:48.073930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:48.074749 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:48.075556 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:48.076378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:48.077109 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:48.077916 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:48.246070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:48.247459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:48.255467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:48.256305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:48.256888 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:48.258159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:48.258790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:48.259724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:48.381935 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:48.400564 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ebf11f2b-64e9-4df2-80f2-2a1de835ce18 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1511 microversion: 2.1 time: 0.341309 Aug 29 20:14:48.407224 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 104/203] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:48 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:48.683209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:48.684979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:48.692436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:48.693420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=6 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:48.728373 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:48.730314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:48.732276 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:48.736009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:48.737308 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:48.738204 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:48.832441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:48.858973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:48.864027 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:48.866598 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-46c30a03-2ab9-44af-abe7-125c353a8a94 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1406 microversion: 2.20 time: 0.625500 Aug 29 20:14:48.870684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 100/204] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:48 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1406 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:49.309187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:49.328575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3af25fa5-1c9d-4eb5-a911-b4a2dd14c17c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.650592 Aug 29 20:14:49.329970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 105/205] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:48 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:49.439427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:49.440763 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:49.443607 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=14 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:49.445339 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:49.455213 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:49.456557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:49.457207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:49.458292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:49.458932 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:49.459437 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:49.707256 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:49.719051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-224eae6f-b173-491a-aa38-57b4e80a45ab tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1511 microversion: 2.1 time: 0.287567 Aug 29 20:14:49.720273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 101/206] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:49 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:49.906483 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:49.907100 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:49.918046 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:49.918965 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:49.924966 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:49.926884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:49.927931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:49.928855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:50.132417 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:50.147555 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:50.150940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:50.152538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6bbc1cdf-d816-49a3-b1d7-d2762f962c71 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1406 microversion: 2.20 time: 0.250845 Aug 29 20:14:50.154083 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 106/207] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:49 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:50.356784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:50.359665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:50.369856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:50.370589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:50.371357 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:50.372627 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:50.374093 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:50.374935 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:50.692350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:50.708248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4f7db66e-2868-4da1-a74b-7574a404647d tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.360083 Aug 29 20:14:50.708842 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 102/208] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:50 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:50.758708 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:50.759929 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:50.769918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:50.770934 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:50.771763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:50.773196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:50.774154 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:50.775617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:50.969315 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:50.981453 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0febd64a-57f2-4e29-bad6-0e5497cb59d4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1511 microversion: 2.1 time: 0.233996 Aug 29 20:14:50.982449 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 107/209] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:50 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:51.184501 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:51.185279 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:51.192764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:51.193250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:51.193682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:51.195097 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:51.195477 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:51.196377 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:51.419293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:51.439791 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:51.443637 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:51.446265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fdae9538-cfbd-42a4-8ffc-b082b6cc5144 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1406 microversion: 2.20 time: 0.265571 Aug 29 20:14:51.448259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 103/210] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:51 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:51.742730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:51.744002 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:51.758354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:51.759338 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:51.760158 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:51.761244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:51.762378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:51.763551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:51.772310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:52.006454 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:52.016237 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:52.017292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:52.020119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-044e18a7-57c7-49fa-bbc8-7c08cec98a4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.283791 Aug 29 20:14:52.021098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 108/211] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:51 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:52.028559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:52.029590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:52.030379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:52.031529 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:52.032520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:52.033414 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:52.242018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:52.256131 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5b8f07f6-a2ab-4bd3-9d90-be88b7eeb122 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1511 microversion: 2.1 time: 0.246756 Aug 29 20:14:52.257425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 104/212] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:52 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:52.490062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:52.491444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:52.499114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:52.500045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:52.500751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:52.501857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:52.502583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:52.503593 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:52.718786 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:52.743940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:52.751232 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:52.754190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7fb9dfa0-4279-4ff5-b8b7-4fec8495bf38 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1406 microversion: 2.20 time: 0.269484 Aug 29 20:14:52.755548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 109/213] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:52 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:52.851099 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-1c5867b1-a170-4ef3-bfaf-5000c7d2b53f req-3aadd0a8-db5c-49ca-badb-0505a5cf2c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86403f3-4482-4e27-9f97-cdf8fc2dd9ad", "name": "network-vif-plugged", "status": "completed", "tag": "4c3e0080-8d58-44c1-8b13-e2b6f6549e47"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:52.873360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1c5867b1-a170-4ef3-bfaf-5000c7d2b53f req-3aadd0a8-db5c-49ca-badb-0505a5cf2c18 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:52.874539 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1c5867b1-a170-4ef3-bfaf-5000c7d2b53f req-3aadd0a8-db5c-49ca-badb-0505a5cf2c18 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:52.875277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1c5867b1-a170-4ef3-bfaf-5000c7d2b53f req-3aadd0a8-db5c-49ca-badb-0505a5cf2c18 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:52.902038 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-1c5867b1-a170-4ef3-bfaf-5000c7d2b53f req-3aadd0a8-db5c-49ca-badb-0505a5cf2c18 service nova] Creating event network-vif-plugged:4c3e0080-8d58-44c1-8b13-e2b6f6549e47 for instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad on hv-cinder-85426 Aug 29 20:14:52.922542 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-1c5867b1-a170-4ef3-bfaf-5000c7d2b53f req-3aadd0a8-db5c-49ca-badb-0505a5cf2c18 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078007 Aug 29 20:14:52.924285 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 105/214] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:53.055713 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:53.056552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:53.067837 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.068403 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.069052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.069876 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.070424 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.070758 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.276011 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:53.284710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:53.285729 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:53.289485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f439125c-59c8-458c-a927-a5d458620d2b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.240083 Aug 29 20:14:53.291109 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 110/215] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:53 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:53.304590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.305222 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.305919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.306917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.307712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.308406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.553975 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:53.569786 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b77c243d-480f-426a-962e-263b5ad01f50 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1511 microversion: 2.1 time: 0.291777 Aug 29 20:14:53.571074 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 106/216] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:53 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:53.790365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:53.791709 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:53.802255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.803157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.804138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.805297 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.806304 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.807025 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:54.051704 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:54.062610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:54.067330 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:54.068879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7f00415b-594e-4c9d-966a-5e75b7082305 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1406 microversion: 2.20 time: 0.285238 Aug 29 20:14:54.069644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 111/217] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:53 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:54.326148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:54.328250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:54.339127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:54.340249 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:54.340850 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:54.341885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:54.343107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:54.343623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:54.587607 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:54.601008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:54.606020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:54.614997 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6e24c44d-997c-44c3-b0ed-f3a464e5df6e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.293612 Aug 29 20:14:54.633503 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:54.633503 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:54.633503 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:54.633942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:54.634745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:54.634926 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 107/218] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:54 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:54.635257 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:54.999693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:55.016548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e309bd9d-e5be-4e7a-a1b1-5d24a4345e0d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1517 microversion: 2.1 time: 0.424244 Aug 29 20:14:55.017485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 112/219] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:54 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1517 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:55.105864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:55.111766 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:55.137644 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:55.138667 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:55.139538 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:55.141234 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:55.144564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:55.146621 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:55.541755 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:55.573583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:55.575470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:55.579022 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-534c2413-6c19-4913-a4f5-4c44a6a96682 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1406 microversion: 2.20 time: 0.480989 Aug 29 20:14:55.579701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 108/220] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:55 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1406 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:55.650687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:55.651862 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:55.664797 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:55.665694 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:55.666800 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:55.668295 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:55.669407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:55.670514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:55.902363 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:55.916952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1ed3866e-4f44-4993-8684-4bf81095acda tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.278420 Aug 29 20:14:55.934717 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 113/221] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:55 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:56.618803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:56.621918 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:56.636453 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:56.637612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:56.639661 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:56.641569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:56.643400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:56.644573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:56.694543 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a32ca5bf-e57f-4ca2-8548-f62a7d71f0fa tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'create', calling method: .version_select at 0x7f15fa2125e0>, body: {"keypair": {"name": "tempest-keypair-1310939457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOG/+gCERGcEv9KdW6i9ecQHauKQnjuxgaMZEY+h+6cSHdCFJDwu5g/d4D0ZeW2B5Od1MTzZcsQP7zsNLnBNEP+g/s6u4vhjv+dBFCEIBdlsDNHTVZic0/C3HcdfdDU4tA=="}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:56.740942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-a32ca5bf-e57f-4ca2-8548-f62a7d71f0fa tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Getting quotas for project bbb0263903e14938b44d9a6b430d84ce. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:14:56.751882 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-a32ca5bf-e57f-4ca2-8548-f62a7d71f0fa tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Getting quotas for user e75b537d44524de192282b10825293f9 and project bbb0263903e14938b44d9a6b430d84ce. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:14:56.814132 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a32ca5bf-e57f-4ca2-8548-f62a7d71f0fa tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124110 Aug 29 20:14:56.815321 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 114/222] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:14:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:14:56.895902 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:56.915148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:56.918392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:56.922523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-84c8cda6-7d0c-4f13-8467-2ba72d63c9ee tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1406 microversion: 2.20 time: 0.311487 Aug 29 20:14:56.924405 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 109/223] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:56 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:56.958813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:56.960512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:56.973552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:56.974565 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:56.975620 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:56.984810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:56.984810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:56.984810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.260169 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:57.280485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8f602c44-c92a-4108-9f85-29d770ba0f8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.327970 Aug 29 20:14:57.283089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 115/224] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:56 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:57.491436 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-e871dd38-9e41-4126-ad15-c80cd5150ad7 req-f43b97d4-c617-4237-8958-3e0717bdcfdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe876d16-ee3b-4423-bc61-402c07105d0d", "name": "network-vif-plugged", "status": "completed", "tag": "80eb06c7-bb62-4e58-b85c-9fc9ea7efddf"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:57.533963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e871dd38-9e41-4126-ad15-c80cd5150ad7 req-f43b97d4-c617-4237-8958-3e0717bdcfdb service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.535868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e871dd38-9e41-4126-ad15-c80cd5150ad7 req-f43b97d4-c617-4237-8958-3e0717bdcfdb service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.537620 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e871dd38-9e41-4126-ad15-c80cd5150ad7 req-f43b97d4-c617-4237-8958-3e0717bdcfdb service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.579452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-e871dd38-9e41-4126-ad15-c80cd5150ad7 req-f43b97d4-c617-4237-8958-3e0717bdcfdb service nova] Creating event network-vif-plugged:80eb06c7-bb62-4e58-b85c-9fc9ea7efddf for instance fe876d16-ee3b-4423-bc61-402c07105d0d on hv-cinder-85426 Aug 29 20:14:57.593421 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-e871dd38-9e41-4126-ad15-c80cd5150ad7 req-f43b97d4-c617-4237-8958-3e0717bdcfdb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119574 Aug 29 20:14:57.595562 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 110/225] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:57.753468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:57.754964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:57.778269 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.782114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.785239 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.786941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.787995 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.789056 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.860550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d35a6a22-d99c-4a09-b714-b2d81e8a3838 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/ips" status: 200 len: 144 microversion: 2.1 time: 0.132836 Aug 29 20:14:57.870837 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 116/226] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:14:57 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/ips => generated 144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:57.959528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:57.960119 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:57.971064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.972713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.973880 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.975329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.976349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.977612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.310202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:58.312444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:58.328151 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:58.329516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:58.330648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.332262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:58.333627 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:58.335015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.367200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:58.394581 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:58.398199 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:58.401115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-96544d19-d926-4c38-bb23-57f48778ac33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1597 microversion: 2.20 time: 0.446562 Aug 29 20:14:58.418738 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 111/227] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:14:57 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1597 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:58.448190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:58.450313 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:58.480999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:58.482065 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:58.483179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.484796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:58.485854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:58.487870 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.727113 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2ea0a37e-cac8-4683-ba42-346e25f0b2a3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.285871 Aug 29 20:14:58.728961 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 112/228] 10.222.0.73 () {60 vars in 1316 bytes} [Mon Aug 29 20:14:58 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-interface => generated 284 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:14:58.879457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:58.905062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-92543e70-911c-4457-be80-79c6b82273de tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.603575 Aug 29 20:14:58.909919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 117/229] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:58 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:59.912488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1544526084", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dca5aa8c-453f-4b91-91f7-9d11ae5d1e40"}], "security_groups": [{"name": "tempest-securitygroup--1817767301"}], "key_name": "tempest-keypair-1310939457", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:59.949842 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:59.950713 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:59.958924 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:59.959572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:59.960128 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:59.961081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:59.961791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:59.962415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:00.260028 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:00.276913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a9b29e18-24e6-466a-806d-4fbfffd04b8e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1314 microversion: 2.1 time: 0.333411 Aug 29 20:15:00.297359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 118/230] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:14:59 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:00.363955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] validate_networks() for [('dca5aa8c-453f-4b91-91f7-9d11ae5d1e40', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:15:00.922443 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acfefc38-b5eb-40cf-ba9c-ae4a09e9e821"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:00.928953 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:00.939161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:00.940470 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:00.940703 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:00.942546 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:00.943314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:00.944060 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:01.636711 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:15:01.636711 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:15:01.638502 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:15:01.639325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:15:01.640107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:15:01.667187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:01.668919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:01.669968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:01.671692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:01.672716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:01.673602 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:01.703022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ab5a3ea6-1596-4fe1-bc33-551f0ac12843 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797919 Aug 29 20:15:01.704858 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 119/231] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:15:00 2022] POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:01.712811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:01.715760 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:01.719228 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Getting quotas for project bbb0263903e14938b44d9a6b430d84ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:01.726778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Getting quotas for user e75b537d44524de192282b10825293f9 and project bbb0263903e14938b44d9a6b430d84ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:01.742642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:01.743557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:01.744024 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:01.745131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:01.745786 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:01.746405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:01.750238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:15:01.755148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:15:01.833217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aacb1066-7bd2-45e7-a0d3-b413c9a51624 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.927910 Aug 29 20:15:01.834415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 113/232] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:14:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:15:01.889496 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-3111e61f-fe83-4c74-bdfa-5295d661f5e2 req-a1b0091f-1fe4-426c-8093-6dc4a6b824bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86403f3-4482-4e27-9f97-cdf8fc2dd9ad", "tag": "4c3e0080-8d58-44c1-8b13-e2b6f6549e47"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:01.933812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3111e61f-fe83-4c74-bdfa-5295d661f5e2 req-a1b0091f-1fe4-426c-8093-6dc4a6b824bc service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:01.940559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3111e61f-fe83-4c74-bdfa-5295d661f5e2 req-a1b0091f-1fe4-426c-8093-6dc4a6b824bc service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:01.941447 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3111e61f-fe83-4c74-bdfa-5295d661f5e2 req-a1b0091f-1fe4-426c-8093-6dc4a6b824bc service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:01.985817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:01.988604 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-3111e61f-fe83-4c74-bdfa-5295d661f5e2 req-a1b0091f-1fe4-426c-8093-6dc4a6b824bc service nova] Creating event network-changed:4c3e0080-8d58-44c1-8b13-e2b6f6549e47 for instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad on hv-cinder-85426 Aug 29 20:15:02.003918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e729e3f0-2b32-47ab-8dc8-9873cbd1acc1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1497 microversion: 2.1 time: 0.296505 Aug 29 20:15:02.007569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-3111e61f-fe83-4c74-bdfa-5295d661f5e2 req-a1b0091f-1fe4-426c-8093-6dc4a6b824bc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135636 Aug 29 20:15:02.008777 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 114/233] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:02.015296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 120/234] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:01 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1497 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:02.020303 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b1559da9-5cf3-4d36-9d74-bd4d4d763dc1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:02.021449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b1559da9-5cf3-4d36-9d74-bd4d4d763dc1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:02.179219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b1559da9-5cf3-4d36-9d74-bd4d4d763dc1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:02.203801 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b1559da9-5cf3-4d36-9d74-bd4d4d763dc1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1246 microversion: 2.1 time: 0.192786 Aug 29 20:15:02.210071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 115/235] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:02 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1246 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:03.247475 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:03.251606 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:03.269123 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.271517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.272360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.274799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.275462 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.276382 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.503282 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:03.504120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:03.516574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:03.523290 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.524664 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.526114 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.527068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.527657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.528214 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.541672 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c5aadd27-5f28-4b04-a8f1-bcef87d7395d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1298 microversion: 2.1 time: 0.305501 Aug 29 20:15:03.554246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 121/236] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:03 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1298 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:03.629331 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:15:03.891392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8087c0f7-5fc1-485d-8de8-cfec17449d48 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 204 len: 0 microversion: 2.1 time: 0.393715 Aug 29 20:15:03.892266 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 116/237] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:15:03 2022] DELETE /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:15:03.904024 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:03.906501 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:03.916908 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.917744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.918454 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.919800 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.921434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.923241 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:04.185586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:04.196550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-474c8c18-9c96-4a5c-8848-77230525da99 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1503 microversion: 2.1 time: 0.298710 Aug 29 20:15:04.197681 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 122/238] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:03 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:04.580185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:04.581290 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:04.591470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:04.592822 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:04.593488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:04.594814 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:04.595509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:04.596131 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:04.704055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:04.719269 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2be95b02-6a8c-4adb-bd0c-ecce17d8c470 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1298 microversion: 2.1 time: 0.146285 Aug 29 20:15:04.720327 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 117/239] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:04 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:05.223694 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:05.224766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:05.235887 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:05.236551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:05.236995 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:05.237732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:05.238199 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:05.238692 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:05.451655 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:05.466893 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-56d1d1d4-364b-4746-b3a5-c8b02208e954 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1503 microversion: 2.1 time: 0.246724 Aug 29 20:15:05.468728 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 123/240] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:05 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:05.746376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:05.747313 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:05.754784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:05.755490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:05.756062 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:05.756824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:05.757362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:05.757895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:05.841829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:05.846646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:05.860220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7c054dcb-9065-4f48-80df-9214c3ff3826 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1298 microversion: 2.1 time: 0.119206 Aug 29 20:15:05.861166 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 118/241] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:05 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:06.494808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:06.497374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:06.528450 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.529694 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.530752 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:06.532325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.533372 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.534368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:06.783690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=4 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:06.819191 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:06.837347 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:06.839769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bc8c3789-be71-442c-8018-50d0b5520d21 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1503 microversion: 2.1 time: 0.350470 Aug 29 20:15:06.854727 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 124/242] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:06 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:06.897986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:06.897986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:06.903678 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.904455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.905766 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:06.906898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.907707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.908378 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.078625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:07.095987 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a4cacaf7-29ee-4408-8d3f-5376397037c4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1304 microversion: 2.1 time: 0.214038 Aug 29 20:15:07.098956 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 119/243] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:06 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:07.878336 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:07.878336 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:07.880457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:07.881343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:07.882110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.883647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:07.888363 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:07.889343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.990116 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:08.004900 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4fb13399-ece7-4cb3-809b-7a900b5527bc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1461 microversion: 2.1 time: 0.140677 Aug 29 20:15:08.005953 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 125/244] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:07 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1461 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:08.024724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-a5c41725-908f-45dc-9420-187dd003dcc4 req-9a3e3b93-9d9b-4677-9ae3-a04b3e9917aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe876d16-ee3b-4423-bc61-402c07105d0d", "name": "network-vif-deleted", "tag": "80eb06c7-bb62-4e58-b85c-9fc9ea7efddf"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:08.039536 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a5c41725-908f-45dc-9420-187dd003dcc4 req-9a3e3b93-9d9b-4677-9ae3-a04b3e9917aa service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.040449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a5c41725-908f-45dc-9420-187dd003dcc4 req-9a3e3b93-9d9b-4677-9ae3-a04b3e9917aa service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.041291 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a5c41725-908f-45dc-9420-187dd003dcc4 req-9a3e3b93-9d9b-4677-9ae3-a04b3e9917aa service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.058219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-a5c41725-908f-45dc-9420-187dd003dcc4 req-9a3e3b93-9d9b-4677-9ae3-a04b3e9917aa service nova] Creating event network-vif-deleted:80eb06c7-bb62-4e58-b85c-9fc9ea7efddf for instance fe876d16-ee3b-4423-bc61-402c07105d0d on hv-cinder-85426 Aug 29 20:15:08.066936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-a5c41725-908f-45dc-9420-187dd003dcc4 req-9a3e3b93-9d9b-4677-9ae3-a04b3e9917aa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047956 Aug 29 20:15:08.068564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 120/245] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:08.134593 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:08.135215 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:08.144080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.144583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.145009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.145995 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.146567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.147026 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.281246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:08.296586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7d76c630-1ce8-47b9-8cc6-e5fed3704b5f tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1304 microversion: 2.1 time: 0.169240 Aug 29 20:15:08.297416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 126/246] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:08 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:09.033395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:09.035683 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:09.059779 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.062595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.063628 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.065160 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.066233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.067239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.157483 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.158367 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.159148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.160008 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lazy-loading 'fault' on Instance uuid fe876d16-ee3b-4423-bc61-402c07105d0d {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:15:09.272679 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:09.289597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-011263f5-9c1f-4559-bd04-b64975098f72 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1304 microversion: 2.1 time: 0.262335 Aug 29 20:15:09.302727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 121/247] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:09 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1304 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:09.320611 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:09.321221 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:09.329908 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.330658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.331336 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.332485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.333205 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.333940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.552871 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:09.565498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-028f3458-8772-4c63-a807-c9267d595209 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1372 microversion: 2.1 time: 0.251564 Aug 29 20:15:09.579224 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 127/248] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:09 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:10.089805 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-27f52190-aa76-42ed-88a4-6f214045cccd req-d6b467fe-8370-472c-a292-6a4bceb71cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e26ac8-5eaa-4408-8208-b082661ea002", "tag": "c2122474-4565-44ec-986a-9646613e2d4e"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:10.105690 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-27f52190-aa76-42ed-88a4-6f214045cccd req-d6b467fe-8370-472c-a292-6a4bceb71cac service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.106188 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-27f52190-aa76-42ed-88a4-6f214045cccd req-d6b467fe-8370-472c-a292-6a4bceb71cac service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.106611 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-27f52190-aa76-42ed-88a4-6f214045cccd req-d6b467fe-8370-472c-a292-6a4bceb71cac service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.125844 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-27f52190-aa76-42ed-88a4-6f214045cccd req-d6b467fe-8370-472c-a292-6a4bceb71cac service nova] Creating event network-changed:c2122474-4565-44ec-986a-9646613e2d4e for instance 06e26ac8-5eaa-4408-8208-b082661ea002 on hv-cinder-85426 Aug 29 20:15:10.133874 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-27f52190-aa76-42ed-88a4-6f214045cccd req-d6b467fe-8370-472c-a292-6a4bceb71cac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050067 Aug 29 20:15:10.134885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 122/249] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:10.335468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:10.340190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:10.352580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.353567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.354372 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.355838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.356844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.357880 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.453793 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.454742 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.455596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.456441 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lazy-loading 'fault' on Instance uuid fe876d16-ee3b-4423-bc61-402c07105d0d {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:15:10.549138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:10.565992 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-db2be0ce-eee3-4eac-b84c-f7bad3ebdfb2 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 200 len: 1304 microversion: 2.1 time: 0.248585 Aug 29 20:15:10.570545 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 128/250] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:10 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 1304 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:10.597891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:10.602242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:10.612216 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.612915 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.613644 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.614808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.615564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.616257 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.925689 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:10.934127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d1a6d450-305d-4c4e-a3fd-3c03bd9843ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1372 microversion: 2.1 time: 0.344112 Aug 29 20:15:10.934710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 123/251] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:10 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:11.284333 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-105abe01-fded-4a29-ada1-b9756443516b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:11.295048 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-105abe01-fded-4a29-ada1-b9756443516b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.297133 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-105abe01-fded-4a29-ada1-b9756443516b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.297932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-105abe01-fded-4a29-ada1-b9756443516b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.411534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-105abe01-fded-4a29-ada1-b9756443516b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Going to try to stop instance {{(pid=120787) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 20:15:11.499944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-105abe01-fded-4a29-ada1-b9756443516b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/action" status: 202 len: 0 microversion: 2.1 time: 0.222790 Aug 29 20:15:11.501330 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 129/252] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:15:11 2022] POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:15:11.519505 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:11.520607 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:11.533325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.533750 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.534198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.535122 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.535503 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.536220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.611569 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:11.612702 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: fe876d16-ee3b-4423-bc61-402c07105d0d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:11.623332 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.624229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.624847 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.626097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.626866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.627504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.647862 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] HTTP exception thrown: Instance fe876d16-ee3b-4423-bc61-402c07105d0d could not be found. Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Request method failure captured: Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d HTTP/1.1 Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR4jxd4bZ17aNNDtvbQ16LudxdDLEMIUJvC-rOeGpDKJ5Wf1ihaiuQtA2Nm0G-RxItqbz0gEaaoc43M_si4FnZ84PU14T5cB_cPYT9iYnUxEwmSSQ7vWbtRdsvSeXLwAaofLFRpX9DJW20haw_5xglj93q-BxUbmy19F9gx5Xa8S5HM Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 95b900960ce84ebba14e9157e030287e Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesActionsTest-1700516509 Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:15:11.650741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/95b900960ce84ebba14e9157e030287e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/95b900960ce84ebba14e9157e030287e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_95b900960ce84ebba14e9157e030287e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/95b900960ce84ebba14e9157e030287e"}]}] Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesActionsTest-1700516509 Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 95b900960ce84ebba14e9157e030287e Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesActionsTest-1700516509 Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesActionsTest-1700516509-project Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: be17fa7c5ebe49efa4bcae7c721a5e01 Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesActionsTest-1700516509-project Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance fe876d16-ee3b-4423-bc61-402c07105d0d could not be found. Aug 29 20:15:11.652746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'fe876d16-ee3b-4423-bc61-402c07105d0d'} Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe876d16-ee3b-4423-bc61-402c07105d0d could not be found. Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:11.655945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe876d16-ee3b-4423-bc61-402c07105d0d could not be found. Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe876d16-ee3b-4423-bc61-402c07105d0d could not be found. Aug 29 20:15:11.657416 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:11.658828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Returning 404 to user: Instance fe876d16-ee3b-4423-bc61-402c07105d0d could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:11.658828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f1939d09-1e56-4573-a707-2f0f54c67d33 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d" status: 404 len: 111 microversion: 2.1 time: 0.054853 Aug 29 20:15:11.658828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 130/253] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:11 2022] GET /compute/v2.1/servers/fe876d16-ee3b-4423-bc61-402c07105d0d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:15:11.688598 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:11.769406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:11.782484 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-80247f72-f25a-493b-a331-60ceeb4a5e1c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.274945 Aug 29 20:15:11.783838 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 124/254] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:11 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:11.847289 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-806897783", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "networks": [{"uuid": "792ae931-1d50-478f-bb03-d694cbfc32a6"}]}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:11.933747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] validate_networks() for [('792ae931-1d50-478f-bb03-d694cbfc32a6', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:15:11.970135 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:11.970347 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:11.980604 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.981432 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.982408 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.983656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.984567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.985229 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.192065 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=8 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:12.236076 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:12.248349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e99f9e5d-b19c-407b-98af-86b1f4406ca3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1372 microversion: 2.1 time: 0.284974 Aug 29 20:15:12.249607 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 125/255] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:11 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:12.592781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:15:12.593537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:15:12.594576 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:15:12.595766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:15:12.596218 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:15:12.611878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:12.612647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:12.613267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.614437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:12.615240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:12.615982 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.647127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Getting quotas for project 95b900960ce84ebba14e9157e030287e. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:12.652473 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Getting quotas for user be17fa7c5ebe49efa4bcae7c721a5e01 and project 95b900960ce84ebba14e9157e030287e. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:12.669186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:15:12.673640 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:15:12.772088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-69c970b6-06d2-4d57-b1bd-305a7d545fbe tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930363 Aug 29 20:15:12.789264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 131/256] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:15:12.800811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a1b74878-3a91-4b17-9517-4308ead5f05b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:12.801677 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a1b74878-3a91-4b17-9517-4308ead5f05b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:12.815335 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:12.816578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:12.838910 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:12.840121 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:12.840406 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.841537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:12.843582 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:12.844278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.032977 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a1b74878-3a91-4b17-9517-4308ead5f05b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:13.047773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a1b74878-3a91-4b17-9517-4308ead5f05b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1213 microversion: 2.1 time: 0.255410 Aug 29 20:15:13.069940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 126/257] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:12 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1213 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:13.137278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:13.156537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8df14ba4-074c-45e8-87ac-18910e49df06 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.350072 Aug 29 20:15:13.163966 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 132/258] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:12 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:13.287365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:13.304573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:13.319429 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.320025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.321124 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.323610 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.324780 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.325842 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.662129 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:13.698512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-93b75a51-3961-44b9-9362-adfda42f03ed tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1372 microversion: 2.1 time: 0.408778 Aug 29 20:15:13.701385 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 127/259] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:13 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1372 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:14.078488 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:14.079602 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:14.096310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.098335 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.099496 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.102267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.102467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.103102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.194014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:14.195025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:14.206490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.207364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.208272 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.210036 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.213150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.214174 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.227290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:14.249981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c77263b3-0866-43d9-8428-78ac0832eecc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1209 microversion: 2.1 time: 0.163816 Aug 29 20:15:14.250631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 133/260] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:14 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:14.491774 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:14.510520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-08191a3c-8035-42fd-a24a-5234e2e356c8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.328495 Aug 29 20:15:14.513775 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 128/261] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:14 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:14.724164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:14.724707 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:14.732327 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.732967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.733277 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.734099 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.734551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.734970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.958023 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:14.973630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-64e68e37-1dc5-46bf-bd98-f601dd68c6b3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1372 microversion: 2.1 time: 0.253418 Aug 29 20:15:14.974666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 134/262] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:14 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:15.289349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:15.291493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:15.299587 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.300070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.300491 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.301185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.301627 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.302228 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.411009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:15.426095 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0daa82f0-9068-4bf5-a3d1-d3616fa0fe34 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1273 microversion: 2.1 time: 0.145678 Aug 29 20:15:15.427308 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 129/263] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:15 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:15.552797 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:15.554143 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:15.566958 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.568126 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.569083 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.571025 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.571941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.572893 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.796040 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-f4f5bffc-f681-4ae5-a950-ff27754167dd req-dab47a91-aa5e-484c-979d-9a1057c30eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e26ac8-5eaa-4408-8208-b082661ea002", "name": "network-vif-plugged", "status": "completed", "tag": "c2122474-4565-44ec-986a-9646613e2d4e"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:15.856673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f4f5bffc-f681-4ae5-a950-ff27754167dd req-dab47a91-aa5e-484c-979d-9a1057c30eb7 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.858866 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f4f5bffc-f681-4ae5-a950-ff27754167dd req-dab47a91-aa5e-484c-979d-9a1057c30eb7 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.860177 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f4f5bffc-f681-4ae5-a950-ff27754167dd req-dab47a91-aa5e-484c-979d-9a1057c30eb7 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.873318 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:15.922186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1256e7cc-9ee9-4ff0-a717-54d407f33047 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.379222 Aug 29 20:15:15.924059 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 135/264] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:15 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:15.942986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-f4f5bffc-f681-4ae5-a950-ff27754167dd req-dab47a91-aa5e-484c-979d-9a1057c30eb7 service nova] Creating event network-vif-plugged:c2122474-4565-44ec-986a-9646613e2d4e for instance 06e26ac8-5eaa-4408-8208-b082661ea002 on hv-cinder-85426 Aug 29 20:15:15.964872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-f4f5bffc-f681-4ae5-a950-ff27754167dd req-dab47a91-aa5e-484c-979d-9a1057c30eb7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177282 Aug 29 20:15:15.967735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 130/265] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:16.013498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:16.013498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:16.022670 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:16.023630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:16.024698 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:16.026174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:16.027727 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:16.028833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:16.269250 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:16.286529 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cc652980-ed25-42a6-8045-95bcb0039dc3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1372 microversion: 2.1 time: 0.284934 Aug 29 20:15:16.298500 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 136/266] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:15 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1372 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:16.461907 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:16.465005 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:16.478570 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:16.479677 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:16.480590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:16.482055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:16.483302 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:16.485936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:16.753011 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:16.768204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8de8b2d3-4488-41aa-892a-ad9a90736ec6 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.313593 Aug 29 20:15:16.769156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 131/267] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:16 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:16.946511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:16.947369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:16.949805 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:16.960360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:16.960976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:16.961501 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:16.962730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:16.963545 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:16.964349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:17.210215 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:17.223247 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2261dd9f-cbdc-491b-ba65-dbc8ee0b083d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.281220 Aug 29 20:15:17.224191 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 137/268] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:16 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:17.330822 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:17.332365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:17.341851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:17.342814 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:17.343987 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:17.345229 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:17.346860 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:17.347704 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:17.688167 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:17.707171 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f13307d5-b28a-43db-b1c7-b9a562d51e48 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1372 microversion: 2.1 time: 0.384924 Aug 29 20:15:17.709510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 132/269] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:17 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1372 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:17.805658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:17.806681 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:17.817276 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:17.818244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:17.818916 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:17.819688 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:17.820333 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:17.821065 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.073920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:18.090188 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f9251a35-2a2d-4179-83cc-743299110f25 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.291242 Aug 29 20:15:18.091653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 138/270] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:17 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:18.138509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-e90b7a7b-e2e1-4663-b1ef-b0942c4952e5 req-daf966f9-ab95-4b1c-875e-f1c5e8a88bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c2c026-be9a-466a-abbe-bc4fa6f7d1da", "tag": "6b429f02-d4c4-4fb5-b1af-16ec99028e58"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:18.154139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e90b7a7b-e2e1-4663-b1ef-b0942c4952e5 req-daf966f9-ab95-4b1c-875e-f1c5e8a88bc2 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:18.155175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e90b7a7b-e2e1-4663-b1ef-b0942c4952e5 req-daf966f9-ab95-4b1c-875e-f1c5e8a88bc2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:18.156204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e90b7a7b-e2e1-4663-b1ef-b0942c4952e5 req-daf966f9-ab95-4b1c-875e-f1c5e8a88bc2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.176259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-e90b7a7b-e2e1-4663-b1ef-b0942c4952e5 req-daf966f9-ab95-4b1c-875e-f1c5e8a88bc2 service nova] Creating event network-changed:6b429f02-d4c4-4fb5-b1af-16ec99028e58 for instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da on hv-cinder-85426 Aug 29 20:15:18.184138 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-e90b7a7b-e2e1-4663-b1ef-b0942c4952e5 req-daf966f9-ab95-4b1c-875e-f1c5e8a88bc2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051234 Aug 29 20:15:18.185235 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 133/271] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:18.253777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:18.254653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:18.262692 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:18.263330 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:18.263812 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.265335 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:18.266024 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:18.274642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.747351 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:18.750678 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:18.767669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:18.768866 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:18.769950 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.771568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:18.772673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:18.773788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.812945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:18.828062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8ba1ceb0-6a7f-4de8-89fe-8aa4b9def185 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.578191 Aug 29 20:15:18.829433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 139/272] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:18 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:19.007296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:19.021615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-892fc707-9107-4de3-a0d8-f13151d1655e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1372 microversion: 2.1 time: 0.282697 Aug 29 20:15:19.022613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 134/273] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:18 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1372 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:19.126247 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:19.127249 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:19.141224 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:19.142096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:19.142959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:19.144557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:19.145473 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:19.146200 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:19.391145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:19.402809 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d0779375-a46a-4293-a050-0883f889bb4c tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.285476 Aug 29 20:15:19.403716 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 140/274] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:19 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:19.861094 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:19.863284 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:19.867020 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:19.877874 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:19.878739 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:19.879946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:19.880837 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:19.881683 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:19.882674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.058043 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:20.058731 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:20.070350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.070731 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.071520 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.072735 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.073560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.074400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.105811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:20.278003 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:20.296374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-627cdae8-ca6a-4e8b-bc9d-8252a442cb49 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1566 microversion: 2.1 time: 0.244830 Aug 29 20:15:20.297974 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 141/275] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:20 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:20.326601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:20.326601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:20.337823 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.339601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.341091 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.343422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.344593 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.345355 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.413655 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:20.429888 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d02f4b0d-cdb5-4301-a795-003faf9db7fc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.575807 Aug 29 20:15:20.432831 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 135/276] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:19 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:20.443867 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:20.445785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:20.469099 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.470002 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.470724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.472057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.472891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.484019 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.546771 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-523eb3dd-d29d-469e-88d5-bfba4d297fde tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.228479 Aug 29 20:15:20.548737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 142/277] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 29 20:15:20 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:20.719778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:20.728861 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8c6c8e52-6e2f-4d5b-808b-1868122a1579 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.294000 Aug 29 20:15:20.742297 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 136/278] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:20 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:21.465176 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:21.467426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:21.492960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:21.499813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:21.502079 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:21.505281 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:21.508281 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:21.513215 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:21.759771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:21.762462 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:21.776785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:21.777884 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:21.778791 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:21.781155 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:21.784016 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:21.784946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:21.910796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:21.924228 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2dd2254e-05a3-49f8-a4e4-656d5a16afad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.466835 Aug 29 20:15:21.925147 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 143/279] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:21 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:22.119070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:22.135691 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a3b1b70e-3dff-4a99-ae7b-f6c4e85571cb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.384727 Aug 29 20:15:22.145275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 137/280] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:21 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:22.296694 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-c9cb4da2-8ae6-4ed8-8c0b-301a41ba072b req-55d003b3-7d30-48f2-890b-535a125e715d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e26ac8-5eaa-4408-8208-b082661ea002", "tag": "c2122474-4565-44ec-986a-9646613e2d4e"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:22.307562 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c9cb4da2-8ae6-4ed8-8c0b-301a41ba072b req-55d003b3-7d30-48f2-890b-535a125e715d service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:22.308216 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c9cb4da2-8ae6-4ed8-8c0b-301a41ba072b req-55d003b3-7d30-48f2-890b-535a125e715d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:22.308635 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c9cb4da2-8ae6-4ed8-8c0b-301a41ba072b req-55d003b3-7d30-48f2-890b-535a125e715d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:22.323312 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-c9cb4da2-8ae6-4ed8-8c0b-301a41ba072b req-55d003b3-7d30-48f2-890b-535a125e715d service nova] Creating event network-changed:c2122474-4565-44ec-986a-9646613e2d4e for instance 06e26ac8-5eaa-4408-8208-b082661ea002 on hv-cinder-85426 Aug 29 20:15:22.329794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-c9cb4da2-8ae6-4ed8-8c0b-301a41ba072b req-55d003b3-7d30-48f2-890b-535a125e715d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037000 Aug 29 20:15:22.330826 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 144/281] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:22.965935 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:22.968365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:22.980584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:22.981451 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:22.982110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:22.983514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:22.985628 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:22.986379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:23.040412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:23.172586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:23.174197 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=6 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:23.183205 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:23.187096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:23.200433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:23.201888 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:23.204043 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:23.206022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:23.207405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:23.208467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:23.475285 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:23.493663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6c57fc22-f9ad-481b-9282-5cfee777223b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.323097 Aug 29 20:15:23.509993 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 145/282] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:23 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:23.662232 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:23.666771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:23.680815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-666afd44-cf83-4ff1-a5b0-542074f1e0d2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.727057 Aug 29 20:15:23.681644 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 138/283] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:22 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:24.533246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:24.534188 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:24.540948 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:24.541850 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:24.542511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:24.543521 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:24.544206 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:24.544878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:24.714744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:24.715589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:24.748740 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:24.750657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:24.752451 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:24.755958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:24.758542 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:24.762068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:24.876393 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:24.890931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-19464b5a-c7bf-4043-a69e-a55689cb8fcb tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.360271 Aug 29 20:15:24.891804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 146/284] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:24 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:25.360575 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:25.388851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ae71f06b-b796-4797-9d7f-a13daac5cf7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.672098 Aug 29 20:15:25.392860 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 139/285] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:24 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:25.939409 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:25.940871 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:25.956274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:25.957540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:25.958380 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:25.959946 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:25.960773 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:25.961539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:26.203323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:26.216698 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-96bcf604-a7dc-4e5d-bc0e-04818f88f84e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.296023 Aug 29 20:15:26.237392 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 147/286] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:25 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:26.432594 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:26.434449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:26.451542 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:26.454758 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:26.456668 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:26.461087 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:26.462549 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:26.463529 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:26.860898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:26.884302 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5992222a-4421-4051-b713-8fb1862aa2e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.458126 Aug 29 20:15:26.886032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 140/287] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:26 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:27.242878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:27.243917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:27.261568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.262901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.263811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.265084 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.266913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.267693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.594742 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:27.606397 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5e002e1d-3e81-42f6-b23b-8f2035936fb1 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.369870 Aug 29 20:15:27.607149 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 148/288] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:27 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:27.924812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:27.926851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:27.944747 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.946046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.948469 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.950157 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.950982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.958508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:28.017749 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-de09bf1e-76f4-45f8-bbdc-08e58e8ca5c6 req-bd3530ff-5105-4b41-bb4b-49ecc52aacca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c2c026-be9a-466a-abbe-bc4fa6f7d1da", "name": "network-vif-plugged", "status": "completed", "tag": "6b429f02-d4c4-4fb5-b1af-16ec99028e58"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:28.032390 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-de09bf1e-76f4-45f8-bbdc-08e58e8ca5c6 req-bd3530ff-5105-4b41-bb4b-49ecc52aacca service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:28.033090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-de09bf1e-76f4-45f8-bbdc-08e58e8ca5c6 req-bd3530ff-5105-4b41-bb4b-49ecc52aacca service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:28.033736 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-de09bf1e-76f4-45f8-bbdc-08e58e8ca5c6 req-bd3530ff-5105-4b41-bb4b-49ecc52aacca service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:28.141865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-de09bf1e-76f4-45f8-bbdc-08e58e8ca5c6 req-bd3530ff-5105-4b41-bb4b-49ecc52aacca service nova] Creating event network-vif-plugged:6b429f02-d4c4-4fb5-b1af-16ec99028e58 for instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da on hv-cinder-85426 Aug 29 20:15:28.168208 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-de09bf1e-76f4-45f8-bbdc-08e58e8ca5c6 req-bd3530ff-5105-4b41-bb4b-49ecc52aacca service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156573 Aug 29 20:15:28.174757 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 149/289] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:28.567449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:28.612724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cc31535e-98d5-4aec-9d6c-f7532c897598 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.692530 Aug 29 20:15:28.616848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 141/290] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:27 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:28.638780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:28.642044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:28.660881 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:28.667259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:28.668077 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:28.669022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:28.669936 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:28.670629 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:29.115306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:29.127851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-00a87ded-8164-49a6-ab90-8336fbc1c00b tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.493397 Aug 29 20:15:29.129062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 150/291] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:28 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:29.653321 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:29.654568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:29.664089 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:29.665321 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:29.666265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:29.667591 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:29.668390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:29.669106 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:29.923381 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:29.939318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-01bbc303-75f5-4105-aff5-88a9aa0d55d0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.289248 Aug 29 20:15:29.944365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 142/292] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:29 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:30.150551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:30.151307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:30.158306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:30.158795 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:30.159222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:30.159921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:30.160563 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:30.160983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:30.384970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:30.415030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-18ca0c2b-e502-4229-b9af-c50b401ed0a7 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.267939 Aug 29 20:15:30.416252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 151/293] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:30 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:30.970811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:30.972059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:30.989498 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:30.990525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:30.992741 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:30.994965 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:30.996080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:30.997563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:31.326618 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:31.340822 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-30cbbb92-10d6-4182-b010-60d233989d4f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.378412 Aug 29 20:15:31.359221 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 143/294] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:30 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:31.454143 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:31.456893 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:31.466376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:31.467077 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:31.468772 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:31.469962 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:31.471376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:31.472203 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:31.776729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:31.787118 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2538abbb-4e61-4ada-ad69-de00fd3e3b01 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.339028 Aug 29 20:15:31.787967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 152/295] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:31 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:32.374724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:32.375498 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:32.383131 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:32.384111 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:32.384871 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:32.385973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:32.386691 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:32.387379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:32.586251 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:32.597653 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7e5dfb3e-8f65-48c2-b30d-f5efdc3d89a4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.228264 Aug 29 20:15:32.599595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 144/296] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:32 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:32.824976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:32.827541 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:32.850243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:32.851105 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:32.851957 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:32.853277 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:32.859685 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:32.860663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:33.307080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:33.330325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-371e707a-7878-4602-baf2-aa8295e269e4 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1313 microversion: 2.1 time: 0.522889 Aug 29 20:15:33.331370 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 153/297] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:32 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:33.641854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:33.643751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:33.675300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:33.680660 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:33.681685 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:33.693429 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:33.694751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:33.695677 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:33.998009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:34.018493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-19b36f49-7b77-4745-b4b2-28739974f695 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1721 microversion: 2.1 time: 0.384552 Aug 29 20:15:34.020880 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 145/298] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:33 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1721 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:34.371741 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:34.379562 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:34.417374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:34.418922 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:34.421133 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:34.423024 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:34.424512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:34.425654 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:34.866499 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:34.907338 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3d297885-ca91-4281-8763-4e4f89e8aac5 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1496 microversion: 2.1 time: 0.547937 Aug 29 20:15:34.911465 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 154/299] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:34 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1496 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:35.058319 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:35.059057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:35.108794 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:35.109697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:35.118796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:35.122239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:35.123408 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:35.125326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:35.518078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:35.551479 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f9e531ca-3819-44b2-a84b-875999b9eaee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1698 microversion: 2.1 time: 0.497139 Aug 29 20:15:35.554242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 146/300] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:35 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1698 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:35.583080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2c31c453-fd5a-4bcd-bb8d-fcd4ec78fb27 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:35.600978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2c31c453-fd5a-4bcd-bb8d-fcd4ec78fb27 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:35.601762 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2c31c453-fd5a-4bcd-bb8d-fcd4ec78fb27 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:35.602814 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2c31c453-fd5a-4bcd-bb8d-fcd4ec78fb27 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:35.676075 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2c31c453-fd5a-4bcd-bb8d-fcd4ec78fb27 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Going to try to start instance {{(pid=120787) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 20:15:35.821609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2c31c453-fd5a-4bcd-bb8d-fcd4ec78fb27 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/action" status: 202 len: 0 microversion: 2.1 time: 0.244117 Aug 29 20:15:35.822401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 155/301] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:15:35 2022] POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:15:35.838950 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:35.840381 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:35.875871 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:35.876735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:35.877517 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:35.892634 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:35.899222 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:35.901282 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.270424 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:36.277986 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:36.295523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.301017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.302868 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.308700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.310622 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.311966 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.375058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:15:36.519381 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:36.532687 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2735c3fd-7c8b-4102-b831-3c733059c375 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1707 microversion: 2.1 time: 0.701337 Aug 29 20:15:36.535191 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 147/302] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:35 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1707 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:36.596684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d41ff706-927b-4003-acd0-eb6d2aca0345 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 204 len: 0 microversion: 2.1 time: 0.349008 Aug 29 20:15:36.597787 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 156/303] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:15:36 2022] DELETE /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:15:36.610740 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:36.612386 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:36.637841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.639160 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.640703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.642299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.643380 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.644365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.950014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:36.969067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f5c6d54e-cd21-4959-b7ef-8d78d3945b19 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1502 microversion: 2.1 time: 0.364609 Aug 29 20:15:36.970656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 148/304] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:36 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:37.566875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:37.569578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:37.580530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:37.581667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:37.582510 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:37.583567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:37.584481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:37.585619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:37.621787 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:37.887162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:37.908246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3d550d36-cae1-47de-83b6-db04132f5a2d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1707 microversion: 2.1 time: 0.348720 Aug 29 20:15:37.908463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 157/305] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:37 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1707 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:38.006160 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:38.008159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:38.019220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:38.020864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:38.021643 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:38.023198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:38.024013 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:38.024769 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:38.372401 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:38.386516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-da51f39e-d364-463c-aeb3-6647b7f59529 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1502 microversion: 2.1 time: 0.389318 Aug 29 20:15:38.390051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 149/306] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:37 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1502 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:38.939855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:38.940737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:38.954464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:38.955445 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:38.956104 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:38.957158 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:38.957999 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:38.958963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.258063 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:39.279170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-becd71dd-02b7-46ae-8ecd-2f80a5ce7eef tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1707 microversion: 2.1 time: 0.343617 Aug 29 20:15:39.282245 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 158/307] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:38 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1707 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:39.415461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:39.416175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:39.428186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:39.431161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:39.434668 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.438279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:39.439409 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:39.440801 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.617976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e57e899c-3e80-4284-9d45-3550b438927c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Action: 'create', calling method: .version_select at 0x7f15f9fcc430>, body: {"keypair": {"name": "tempest-TestShelveInstance-667803329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnXjlS9t4A4i17ku3uvvHyeDUebyU6t8acktle1RI9871/l/jP0ruEVv6qcm41LIVhaGbcDz3xPxcTq52hd8pcecsn6BzDuZoU4pNLM1jbJoIG3xl1RouU2w3PXy9ao6w=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:39.678885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-e57e899c-3e80-4284-9d45-3550b438927c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Getting quotas for project 98b4b754e82445a0b65e88f5dbede11b. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:39.696494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-e57e899c-3e80-4284-9d45-3550b438927c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Getting quotas for user 70c47e7154fd41a7adb4735a519f1484 and project 98b4b754e82445a0b65e88f5dbede11b. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:39.777227 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e57e899c-3e80-4284-9d45-3550b438927c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.623916 Aug 29 20:15:39.778444 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 150/308] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:15:39 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:39.870259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:39.886019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0728f5bb-2172-4d18-bcc3-70dcef1e8eff tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1502 microversion: 2.1 time: 0.474485 Aug 29 20:15:39.889155 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 159/309] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:39 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1502 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:40.313557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:40.314377 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:40.324756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.325573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.326331 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:40.328069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.328855 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.329555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:40.922188 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:40.923866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:40.933696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.934802 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.935600 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:40.936560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.937420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.938014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:41.080552 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:41.106817 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0098fba2-280a-4865-ad6e-473849f5cb7d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1707 microversion: 2.1 time: 0.797494 Aug 29 20:15:41.108867 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 151/310] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:40 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1707 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:41.276561 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:41.289380 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-13f0b841-11be-47e3-bdfe-e12ea0a2167f tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1502 microversion: 2.1 time: 0.372741 Aug 29 20:15:41.290034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 160/311] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:40 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1502 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:41.576379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-3f53c0cd-38c0-4984-805c-01900c48bab2 req-4511a0e3-c2c9-49f3-9fc0-64c4e4a08a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c2c026-be9a-466a-abbe-bc4fa6f7d1da", "name": "network-vif-deleted", "tag": "6b429f02-d4c4-4fb5-b1af-16ec99028e58"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:41.591805 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3f53c0cd-38c0-4984-805c-01900c48bab2 req-4511a0e3-c2c9-49f3-9fc0-64c4e4a08a19 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:41.593080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3f53c0cd-38c0-4984-805c-01900c48bab2 req-4511a0e3-c2c9-49f3-9fc0-64c4e4a08a19 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:41.596539 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3f53c0cd-38c0-4984-805c-01900c48bab2 req-4511a0e3-c2c9-49f3-9fc0-64c4e4a08a19 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:41.623559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-3f53c0cd-38c0-4984-805c-01900c48bab2 req-4511a0e3-c2c9-49f3-9fc0-64c4e4a08a19 service nova] Creating event network-vif-deleted:6b429f02-d4c4-4fb5-b1af-16ec99028e58 for instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da on hv-cinder-85426 Aug 29 20:15:41.633299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-3f53c0cd-38c0-4984-805c-01900c48bab2 req-4511a0e3-c2c9-49f3-9fc0-64c4e4a08a19 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061864 Aug 29 20:15:41.637116 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 152/312] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:42.140119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:42.141435 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:42.151277 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.152985 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.154011 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.154780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.155463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.156054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.336539 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:42.338659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:42.348952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.349848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.350881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.352567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.354222 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.354813 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.463822 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:42.465608 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.485586 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.487235 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.490035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lazy-loading 'fault' on Instance uuid b1c2c026-be9a-466a-abbe-bc4fa6f7d1da {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:15:42.497166 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5cffed80-4fab-4d91-8297-d86e847ffba4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1707 microversion: 2.1 time: 0.361268 Aug 29 20:15:42.498528 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 161/313] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:42 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1707 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:42.578547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:42.591933 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ac64a7d8-41e1-4fec-8035-526af389c3cc tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1303 microversion: 2.1 time: 0.264425 Aug 29 20:15:42.593465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 153/314] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:42 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:43.529033 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:43.529932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:43.564608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.565599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.566601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.568514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.571988 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.576175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.619303 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:43.620600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:43.644407 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.651176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.651878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.653053 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.653517 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.653983 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.776862 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.793350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.794092 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.794704 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lazy-loading 'fault' on Instance uuid b1c2c026-be9a-466a-abbe-bc4fa6f7d1da {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:15:44.063259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:44.078099 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7c99ec26-35af-442a-afa0-f9870e40e45e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1711 microversion: 2.1 time: 0.559054 Aug 29 20:15:44.099050 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 162/315] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:43 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1711 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:44.184074 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be17fa7c5ebe49efa4bcae7c721a5e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b900960ce84ebba14e9157e030287e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:44.193650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a145dd78-bf1b-4a1b-b486-51837b84a3c3 tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 200 len: 1303 microversion: 2.1 time: 0.580561 Aug 29 20:15:44.210341 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 154/316] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:43 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 1303 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:45.227969 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:45.230394 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] [instance: b1c2c026-be9a-466a-abbe-bc4fa6f7d1da] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:45.245646 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:45.246769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:45.247757 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:45.250212 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:45.252038 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:45.254954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:45.305246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] HTTP exception thrown: Instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da could not be found. Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Request method failure captured: Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da HTTP/1.1 Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR4jxd4bZ17aNNDtvbQ16LudxdDLEMIUJvC-rOeGpDKJ5Wf1ihaiuQtA2Nm0G-RxItqbz0gEaaoc43M_si4FnZ84PU14T5cB_cPYT9iYnUxEwmSSQ7vWbtRdsvSeXLwAaofLFRpX9DJW20haw_5xglj93q-BxUbmy19F9gx5Xa8S5HM Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 95b900960ce84ebba14e9157e030287e Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesActionsTest-1700516509 Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:15:45.307684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/95b900960ce84ebba14e9157e030287e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/95b900960ce84ebba14e9157e030287e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_95b900960ce84ebba14e9157e030287e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/95b900960ce84ebba14e9157e030287e"}]}] Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesActionsTest-1700516509 Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 95b900960ce84ebba14e9157e030287e Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesActionsTest-1700516509 Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesActionsTest-1700516509-project Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: be17fa7c5ebe49efa4bcae7c721a5e01 Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesActionsTest-1700516509-project Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da could not be found. Aug 29 20:15:45.310630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'b1c2c026-be9a-466a-abbe-bc4fa6f7d1da'} Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da could not be found. Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:45.312722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da could not be found. Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da could not be found. Aug 29 20:15:45.316274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:15:45.320362 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] Returning 404 to user: Instance b1c2c026-be9a-466a-abbe-bc4fa6f7d1da could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:45.320362 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e9c73664-559e-41fe-b5b0-9a9bda312d2e tempest-VolumesActionsTest-1700516509 tempest-VolumesActionsTest-1700516509-project] 10.222.0.73 "GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da" status: 404 len: 111 microversion: 2.1 time: 0.094115 Aug 29 20:15:45.332499 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 163/317] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:15:45 2022] GET /compute/v2.1/servers/b1c2c026-be9a-466a-abbe-bc4fa6f7d1da => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:16:19.416729 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:19.417601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:19.419727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:19.420780 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:19.422222 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=91 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:19.440279 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:19.440772 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:19.441241 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:19.442168 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:19.443266 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:19.444519 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:19.499378 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ed7c8418-1002-4161-a149-2e00d2d1b567 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/ips" status: 200 len: 151 microversion: 2.20 time: 0.086637 Aug 29 20:16:19.508797 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 155/318] 10.222.0.73 () {60 vars in 1289 bytes} [Mon Aug 29 20:16:19 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:16:22.587780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:22.589838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:22.594841 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:22.596504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=37 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:22.603278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:22.603870 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:22.604526 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:22.605310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:22.605802 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:22.606397 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:22.646035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lazy-loading 'flavor' on Instance uuid b86403f3-4482-4e27-9f97-cdf8fc2dd9ad {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:16:28.571959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4eaae9b1-8216-4884-b236-bb5d4646ddfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/action" status: 202 len: 0 microversion: 2.20 time: 5.990353 Aug 29 20:16:28.576861 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 164/319] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 29 20:16:22 2022] POST /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/action => generated 0 bytes in 5993 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:28.592559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:28.594984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:28.604042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:28.604750 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:28.605582 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:28.606822 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:28.607530 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:28.608201 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:28.844527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:28.855573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:28.859435 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:28.860348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-551c5c23-319d-4e05-b28f-da90f441b848 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.279410 Aug 29 20:16:28.873103 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 156/320] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:28 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:29.901819 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:29.902549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:29.911343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:29.911928 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:29.912654 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:29.913464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:29.913963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:29.914523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:29.961241 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d447c8eb-7f88-49c1-a274-ddc4b38067ce"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:29.965215 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:29.975353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:29.976080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:29.976893 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:29.978229 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:29.979065 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:29.979877 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:30.145538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:30.162812 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:30.171247 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:30.174712 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-df466d67-4b6b-4865-b0b8-2a22d36d7fdd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.280142 Aug 29 20:16:30.175515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 165/321] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:29 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:30.731621 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bdc40b4f-e882-4965-bf42-d98319143228 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792064 Aug 29 20:16:30.734488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 157/322] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:16:29 2022] POST /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:31.201194 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:31.202066 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:31.212536 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:31.213159 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:31.213614 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:31.214626 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:31.214818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:31.215234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:31.420853 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:31.437780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:31.439871 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:31.442045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c26b5548-f6ee-4a1d-aed2-accac0e64808 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.245222 Aug 29 20:16:31.443060 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 166/323] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:31 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:32.476412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:32.478878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:32.505404 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:32.506403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:32.507229 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:32.509798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:32.510630 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:32.511086 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:32.752610 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:32.767833 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:32.770797 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:32.772900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-644ba1f7-eb8f-4889-8505-95a08780d66f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.307470 Aug 29 20:16:32.774333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 158/324] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:32 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:33.811165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:33.812667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:33.820865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:33.821668 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:33.822289 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:33.823047 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:33.823659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:33.824255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:34.076670 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:34.091051 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:34.099602 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:34.099602 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a5c69e24-6eba-4cc3-95e1-53dae5989dfb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.294145 Aug 29 20:16:34.099602 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 167/325] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:33 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:34.967105 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1375010661", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-667803329", "security_groups": [{"name": "tempest-secgroup-smoke-1907335673"}], "networks": [{"uuid": "1a747b50-d4d8-4125-b72a-614b7c20e71e"}], "block_device_mapping_v2": [{"uuid": "711e355b-265c-49f3-8c5c-d361483d9941", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:35.146420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:35.147511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:35.167051 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:35.167884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:35.168653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:35.170156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:35.171058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:35.172323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:35.227491 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] validate_networks() for [('1a747b50-d4d8-4125-b72a-614b7c20e71e', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:16:35.495539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:35.510339 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:35.512825 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:35.514917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-80b368ab-8297-4168-b889-1ad38ca7a105 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.375857 Aug 29 20:16:35.516248 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 168/326] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:35 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:36.032473 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:16:36.033277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:16:36.033852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:16:36.034519 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:16:36.035030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:16:36.047854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:36.048661 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:36.049295 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:36.050614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:36.051374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:36.052116 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:36.075346 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Getting quotas for project 98b4b754e82445a0b65e88f5dbede11b. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:16:36.080231 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Getting quotas for user 70c47e7154fd41a7adb4735a519f1484 and project 98b4b754e82445a0b65e88f5dbede11b. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:16:36.180525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:16:36.184798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='711e355b-265c-49f3-8c5c-d361483d9941',volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:16:36.440202 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-436eb45b-ce98-437a-a1a4-13ab2ecb33dc tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.477565 Aug 29 20:16:36.441094 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 159/327] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:16:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:16:36.463248 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-db3534b1-2193-4861-9979-f19ddfe81e51 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:36.466057 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-db3534b1-2193-4861-9979-f19ddfe81e51 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:36.560679 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:36.561645 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:36.568084 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-db3534b1-2193-4861-9979-f19ddfe81e51 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:36.573743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:36.576572 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:36.577560 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:36.579675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:36.580540 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:36.581264 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:36.584845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-db3534b1-2193-4861-9979-f19ddfe81e51 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1088 microversion: 2.1 time: 0.128894 Aug 29 20:16:36.585857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 169/328] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:36 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1088 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:36.842159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:36.855149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:36.857812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:36.859785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3e61752c-8046-4db9-8306-bdce45fbc7f8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.305322 Aug 29 20:16:36.860418 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 160/329] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:36 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:37.614613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:37.615764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:37.628488 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:37.629065 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:37.629542 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:37.630444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:37.630953 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:37.631667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:37.733779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:37.747948 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f7570ce5-21aa-4a7b-a473-f4e03f1ef2fa tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1138 microversion: 2.1 time: 0.142240 Aug 29 20:16:37.748952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 170/330] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:37 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1138 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:37.899001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:37.899763 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:37.908960 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:37.909489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:37.909982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:37.910718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:37.911180 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:37.911650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:38.191509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:38.202458 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:38.204357 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:38.205892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c8ec8491-00fc-42da-b618-fe146b2a3ada tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.311450 Aug 29 20:16:38.206597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 161/331] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:37 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:38.783718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:38.784523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:38.795738 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:38.796510 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:38.797653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:38.799210 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:38.799912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:38.800556 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:38.910426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:38.926439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b6e7fcaa-248d-4857-a578-09e9f0f97587 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1186 microversion: 2.1 time: 0.150188 Aug 29 20:16:38.927398 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 171/332] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:38 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1186 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:39.251219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:39.252092 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:39.264313 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.265863 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.267846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.269908 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.271533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.273052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.554969 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:39.565838 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:39.567397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:39.568801 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-040cbd30-9f8c-4809-a15b-58113d6a7293 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.327204 Aug 29 20:16:39.569382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 162/333] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:39 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:39.936801 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:39.939427 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:39.948148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.948819 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.949411 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.950288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.950819 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.951322 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.966304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:39.967345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:39.975967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.976546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.977202 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.978454 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.979102 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.979601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.991793 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lazy-loading 'flavor' on Instance uuid 06e26ac8-5eaa-4408-8208-b082661ea002 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:16:40.141291 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:40.185803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d126c99a-60be-422d-8e77-554281ab72d0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1186 microversion: 2.1 time: 0.216278 Aug 29 20:16:40.185803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 163/334] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:39 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1186 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:40.248174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-fe3cbb66-c8bb-4578-ad49-bc8bec6ce035 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/action" status: 200 len: 32 microversion: 2.1 time: 0.316308 Aug 29 20:16:40.248664 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 172/335] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:16:39 2022] POST /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/action => generated 32 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:16:40.259837 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:40.260903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:40.277077 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:40.277811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:40.278065 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:40.279133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:40.279805 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:40.281126 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:40.615809 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:40.617058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:40.624802 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:40.625314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:40.625782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:40.626835 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:40.635718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:40.635718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:40.681863 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:40.693980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-82dc1277-ac00-4512-b6f8-14c894e4aa8d tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.438018 Aug 29 20:16:40.694959 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 164/336] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:40 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:41.061666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:41.080043 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:41.081807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:41.085257 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a53a580d-7552-45a3-a3ba-6dd16ee12db8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.474681 Aug 29 20:16:41.102811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 173/337] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:40 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:41.206267 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:41.206927 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:41.222422 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:41.223808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:41.225082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:41.226411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:41.226922 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:41.227467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:41.432411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:41.460898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bf501744-c604-4990-b365-9d605c4fc76e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1204 microversion: 2.1 time: 0.258988 Aug 29 20:16:41.463222 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 165/338] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:41 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1204 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:41.728205 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:41.729236 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:41.741407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:41.743196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:41.744151 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:41.745849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:41.747045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:41.748654 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:42.119449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:42.120681 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:42.139398 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:42.141183 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:42.142010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:42.143647 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:42.144744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:42.146613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:42.188733 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:42.214892 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-654bf1a2-2a25-4271-a1c7-5fcb49a90d45 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.493702 Aug 29 20:16:42.215807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 174/339] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:41 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:42.439815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:42.455345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:42.458467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:42.460038 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fd4c537f-9550-4c16-b0cb-e34ec8661def tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.352278 Aug 29 20:16:42.460986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 166/340] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:42 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:42.498245 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:42.499116 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:42.512748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:42.520890 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:42.522061 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:42.523541 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:42.524387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:42.525115 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:42.936334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:42.959371 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a9acefbf-ffe9-41cd-83c0-00d558430ab5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.465904 Aug 29 20:16:42.960238 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 175/341] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:42 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:43.250884 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:43.251735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:43.259128 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:43.259823 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:43.260364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:43.261672 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:43.264153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:43.264153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:43.464207 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-d8625d2e-d0f2-4d82-a904-a1a754f0af62 req-077b4174-d778-4bf3-8d26-938fb63abe4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9470292c-17d1-47bf-9ea3-c5b0eb069a12", "tag": "e83470af-1797-4000-830e-cdec3cee207b"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:43.496865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d8625d2e-d0f2-4d82-a904-a1a754f0af62 req-077b4174-d778-4bf3-8d26-938fb63abe4d service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:43.498223 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d8625d2e-d0f2-4d82-a904-a1a754f0af62 req-077b4174-d778-4bf3-8d26-938fb63abe4d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:43.499708 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d8625d2e-d0f2-4d82-a904-a1a754f0af62 req-077b4174-d778-4bf3-8d26-938fb63abe4d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:43.508271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:43.522286 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-d8625d2e-d0f2-4d82-a904-a1a754f0af62 req-077b4174-d778-4bf3-8d26-938fb63abe4d service nova] Creating event network-changed:e83470af-1797-4000-830e-cdec3cee207b for instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 on hv-cinder-85426 Aug 29 20:16:43.529596 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bd83d813-2866-4f7a-a8fd-e8a799ade790 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.283213 Aug 29 20:16:43.531441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 167/342] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:43 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:43.534640 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-d8625d2e-d0f2-4d82-a904-a1a754f0af62 req-077b4174-d778-4bf3-8d26-938fb63abe4d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081768 Aug 29 20:16:43.537403 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 176/343] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:43.558131 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:43.559201 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:43.570716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:43.571608 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:43.572384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:43.573750 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:43.574562 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:43.575233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:43.811270 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:43.822388 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:43.825991 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:43.828667 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-22ef9142-50a1-4dfa-8227-9e66117e38fd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.294996 Aug 29 20:16:43.829591 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 168/344] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:43 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:43.983871 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:43.986366 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:43.998980 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:44.000128 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:44.000959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:44.002290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:44.003116 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:44.003574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:44.346942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:44.366316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e6bb9209-d921-493f-ace7-047366dfceb2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.388419 Aug 29 20:16:44.367380 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 177/345] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:43 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:44.561616 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:44.561616 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:44.569290 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:44.570284 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:44.570905 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:44.571984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:44.572803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:44.573465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:44.766094 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:44.776357 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-36fb789b-ecb4-4a36-8fe7-22c2c10c834b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.222871 Aug 29 20:16:44.777189 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 169/346] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:44 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:44.866666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:44.867682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:44.878576 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:44.879316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:44.879761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:44.880553 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:44.881010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:44.881430 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:44.886948 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:45.180348 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:45.192269 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:45.194093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:45.195647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6ea20109-5a2e-43b1-8721-41627f77cacd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.335502 Aug 29 20:16:45.196230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 178/347] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:44 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:45.399636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:45.400723 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:45.408851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:45.409438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:45.410212 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:45.410511 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:45.410982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:45.411565 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:45.616380 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:45.644333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-339dabc6-c8bd-438c-9ed8-d9ecab4dcf29 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.251760 Aug 29 20:16:45.645605 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 170/348] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:45 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:45.808546 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:45.809374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:45.817598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:45.818210 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:45.818951 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:45.819742 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:45.821241 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:45.822403 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:46.026940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:46.037514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-175a5766-412e-4729-969b-e3839b317fb7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.236870 Aug 29 20:16:46.038259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 179/349] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:45 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:46.239636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:46.240241 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:46.243044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:46.243916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:46.251415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:46.251920 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:46.252350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:46.253080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:46.253943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:46.254087 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:46.259954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:46.437993 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:46.447563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:46.449210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:46.450429 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-430ce0a5-a576-4562-8774-0e92e2b1c4b3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.217067 Aug 29 20:16:46.450997 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 171/350] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:46 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:46.680103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:46.681088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:46.684079 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:46.692634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:46.693340 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:46.693855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:46.694847 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:46.695552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:46.696109 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:46.866971 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:46.878288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-610d5cf6-bec5-411c-952a-a57bc3503ece tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.202823 Aug 29 20:16:46.879187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 180/351] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:46 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:47.060612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:47.061697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:47.070350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:47.071330 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:47.071330 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:47.072359 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:47.073070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:47.073821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:47.289004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:47.304196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-27432afa-f250-46ce-8304-5043159749a6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.247672 Aug 29 20:16:47.304800 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 172/352] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:47 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:47.490355 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:47.491629 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:47.499631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:47.501337 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:47.502385 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:47.503412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:47.503990 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:47.504421 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:47.710046 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:47.718896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:47.720936 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:47.722183 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d164e9a4-7c79-4996-8521-b5dbe9d46f57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.236857 Aug 29 20:16:47.722844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 181/353] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:47 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:47.905154 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:47.907383 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:47.918666 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:47.919554 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:47.920333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:47.921269 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:47.922612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:47.923392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:48.117549 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:48.126716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5d5af95f-75f3-4a44-b76f-5e1b78c56902 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.229352 Aug 29 20:16:48.129435 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 173/354] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:47 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:48.342296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:48.343444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:48.354289 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:48.355182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:48.355950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:48.357201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:48.358076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:48.358840 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:48.553088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:48.565258 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c939ca55-b2b3-42e8-88d3-3ba9545ed4ae tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.230242 Aug 29 20:16:48.565864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 182/355] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:48 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:48.755419 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:48.756124 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:48.763631 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:48.764164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:48.764653 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:48.765316 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:48.765931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:48.766356 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:48.939979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:48.954904 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:48.957271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:48.958842 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f1f27add-c85c-4768-b30e-c9fac4b7c672 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.208706 Aug 29 20:16:48.959427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 174/356] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:48 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:49.151748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:49.152868 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:49.162935 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:49.163684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:49.164346 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:49.165526 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:49.166213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:49.166914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:49.361816 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:49.376231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5d1afed1-18d5-4eff-86bc-2110016e0abf tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.230106 Aug 29 20:16:49.377339 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 183/357] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:49 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:49.589675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:49.590470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:49.593810 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:49.602211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:49.602620 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:49.603058 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:49.603768 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:49.604225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:49.604652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:49.826200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:49.841524 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-545113bf-86af-4174-aebd-945df65a1c2e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.255486 Aug 29 20:16:49.842282 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 175/358] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:49 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:49.984008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:49.985767 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:49.996110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:49.996976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:49.997128 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:49.997953 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:49.998661 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:49.999270 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:50.305018 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:50.325542 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:50.330465 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:50.332036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b162a201-4ac9-4b9e-bd94-d0b7bb07cb7a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1743 microversion: 2.20 time: 0.352193 Aug 29 20:16:50.333028 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 184/359] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:49 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1743 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:50.403645 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:50.404790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:50.417391 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:50.418206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:50.419018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:50.420319 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:50.421246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:50.422710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:50.696746 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:50.715103 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6adbd6da-a76c-4ec0-8482-246df6b00c8e tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.318215 Aug 29 20:16:50.716737 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 176/360] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:50 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:50.867304 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:50.868012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:50.877586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:50.878449 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:50.879187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:50.880070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:50.880538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:50.880977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:51.113675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:51.129763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-18fe055d-3e56-4d19-8892-9041fe0ad31c tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.268714 Aug 29 20:16:51.131925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 185/361] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:50 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:51.369267 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:51.370752 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:51.383944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:51.384702 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:51.385648 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:51.386903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:51.387703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:51.388411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:51.599568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:51.610272 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:51.612325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:51.614006 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-187f08a8-f21b-477a-951f-387c6195a041 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1743 microversion: 2.20 time: 0.251880 Aug 29 20:16:51.614827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 177/362] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:51 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:51.759383 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:51.760383 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:51.768754 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:51.769266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:51.769746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:51.770780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:51.771244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:51.771670 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:51.995395 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:52.007458 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ec5ad370-e5c6-42e4-978a-5d7264e8ad08 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.251342 Aug 29 20:16:52.008559 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 186/363] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:51 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:52.167852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:52.168690 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:52.178456 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:52.179011 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:52.179956 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:52.180887 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:52.181358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:52.181817 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:52.427270 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-2b3748cd-9616-4fb9-ac08-c89aa8ef1f62 req-5c30d0ce-efa5-482e-9077-8a5a4ab84dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86403f3-4482-4e27-9f97-cdf8fc2dd9ad", "name": "network-vif-plugged", "status": "completed", "tag": "4c3e0080-8d58-44c1-8b13-e2b6f6549e47"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:52.458653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-2b3748cd-9616-4fb9-ac08-c89aa8ef1f62 req-5c30d0ce-efa5-482e-9077-8a5a4ab84dd8 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:52.459636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-2b3748cd-9616-4fb9-ac08-c89aa8ef1f62 req-5c30d0ce-efa5-482e-9077-8a5a4ab84dd8 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:52.460360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-2b3748cd-9616-4fb9-ac08-c89aa8ef1f62 req-5c30d0ce-efa5-482e-9077-8a5a4ab84dd8 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:52.525981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-2b3748cd-9616-4fb9-ac08-c89aa8ef1f62 req-5c30d0ce-efa5-482e-9077-8a5a4ab84dd8 service nova] Creating event network-vif-plugged:4c3e0080-8d58-44c1-8b13-e2b6f6549e47 for instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad on hv-cinder-85426 Aug 29 20:16:52.544852 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-2b3748cd-9616-4fb9-ac08-c89aa8ef1f62 req-5c30d0ce-efa5-482e-9077-8a5a4ab84dd8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129046 Aug 29 20:16:52.545504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 187/364] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:16:52.577536 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:52.603054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-011a9790-c81d-4e6b-8b2e-b0547ffd4ac9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.441617 Aug 29 20:16:52.604013 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 178/365] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:52 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:52.652556 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:52.653759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:52.661020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=51 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:52.669261 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:52.670020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:52.670760 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:52.671839 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:52.675205 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:52.676822 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:52.885041 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:52.896020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:52.897562 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:52.898827 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c0fd9a4c-030a-4aed-b8ce-9aca3e28362e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.254933 Aug 29 20:16:52.899487 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 188/366] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:52 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:53.042208 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:53.043840 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:53.055308 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:53.056353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:53.056849 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:53.057771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:53.058713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:53.061355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:53.305424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:53.324139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-857ef121-af37-43ec-abbf-24902ddcc72c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.288843 Aug 29 20:16:53.325102 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 179/367] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:53 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:53.639051 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:53.640520 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:53.663645 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:53.664756 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:53.665227 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:53.665982 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:53.666606 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:53.667040 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:53.886998 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1435530127", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:54.024428 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:54.043013 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-628a185b-8537-4de4-8cff-90f06c8beac7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.412113 Aug 29 20:16:54.070979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 189/368] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:53 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:54.082612 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:54.083841 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:54.094784 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:54.095561 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:54.096318 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:54.097692 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:54.098803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:54.099841 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:54.345787 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:54.366189 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:54.369474 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:54.372162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d98a21cf-c45a-447a-a372-0e4bc419b191 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.298831 Aug 29 20:16:54.373808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 190/369] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:54 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:54.383751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:54.385577 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:54.398767 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:54.399999 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:54.401052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:54.403110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:54.404145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:54.404681 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:54.702220 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:54.715560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-494479b4-232f-4edb-9f9a-7454b8949149 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.339418 Aug 29 20:16:54.716613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 191/370] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:54 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:55.084256 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:55.089481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:55.102235 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.103077 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.103794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:55.104956 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.106073 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.106984 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:55.395156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:55.413836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6b7c67ed-bc8f-4233-a1bc-d44f017f2251 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.337293 Aug 29 20:16:55.435017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 192/371] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:55 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:55.450477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-790c3db8-49fe-47c2-b7c9-1bc5318beffb req-f1c44dca-28ed-48c0-ab29-f81cb5e790b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9470292c-17d1-47bf-9ea3-c5b0eb069a12", "name": "network-vif-plugged", "status": "completed", "tag": "e83470af-1797-4000-830e-cdec3cee207b"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:55.472130 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-790c3db8-49fe-47c2-b7c9-1bc5318beffb req-f1c44dca-28ed-48c0-ab29-f81cb5e790b6 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.472881 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-790c3db8-49fe-47c2-b7c9-1bc5318beffb req-f1c44dca-28ed-48c0-ab29-f81cb5e790b6 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.473541 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-790c3db8-49fe-47c2-b7c9-1bc5318beffb req-f1c44dca-28ed-48c0-ab29-f81cb5e790b6 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:55.485506 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] validate_networks() for None {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:16:55.497445 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-790c3db8-49fe-47c2-b7c9-1bc5318beffb req-f1c44dca-28ed-48c0-ab29-f81cb5e790b6 service nova] Creating event network-vif-plugged:e83470af-1797-4000-830e-cdec3cee207b for instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 on hv-cinder-85426 Aug 29 20:16:55.507617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-790c3db8-49fe-47c2-b7c9-1bc5318beffb req-f1c44dca-28ed-48c0-ab29-f81cb5e790b6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069883 Aug 29 20:16:55.508669 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 193/372] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:55.519495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:55.520870 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:55.531758 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.532849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.534170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:55.535684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.536879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.537832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:55.866265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:55.893175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:55.898496 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:55.902344 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-80dbbe7d-63a8-4530-ab89-c813d858dffc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.391268 Aug 29 20:16:55.903750 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 194/373] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:55 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:55.944858 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:55.945080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:55.984884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.985682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.986400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:55.993729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.994558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.995315 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:56.131003 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:16:56.132058 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:16:56.133034 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:16:56.133671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:16:56.135198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:16:56.152623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:56.154752 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:56.157955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:56.159169 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:56.160309 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:56.162424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:56.214765 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Getting quotas for project 1b6e748b13ea4fc5ad88eaee50ffa437. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:16:56.221341 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Getting quotas for user b41427ee7f3a4b478f5587b41a3b9e5e and project 1b6e748b13ea4fc5ad88eaee50ffa437. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:16:56.241496 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:16:56.244568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:16:56.304839 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a8b5e38d-1f84-4c01-81ff-0650bcdbbfe8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.432265 Aug 29 20:16:56.306459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 180/374] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:16:56.319290 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:56.327051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:56.352064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:56.358711 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:56.360780 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:56.363187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:56.364915 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:56.368642 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:56.534881 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:56.610065 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c74c09d0-0542-460a-be0c-6ddbb2bf2a95 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.692819 Aug 29 20:16:56.611066 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 195/375] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:55 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:56.629374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bcb81bed-b443-46e2-93c8-1176e71070be tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:56.630858 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bcb81bed-b443-46e2-93c8-1176e71070be tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:56.741429 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lazy-loading 'services' on Instance uuid 856657fa-097f-45c6-baeb-cc6a9d494a26 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:16:56.756528 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bcb81bed-b443-46e2-93c8-1176e71070be tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:56.776944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bcb81bed-b443-46e2-93c8-1176e71070be tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1215 microversion: 2.1 time: 0.163623 Aug 29 20:16:56.785987 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 196/376] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:56 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:56.798851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:56.800377 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:56.813856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:56.814675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:56.815886 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:56.818164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:56.819346 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:56.820097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:56.925554 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=100 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:57.091485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-05c83a91-ac20-4674-aa0f-d623045540d9 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/os-volume_attachments/acfefc38-b5eb-40cf-ba9c-ae4a09e9e821" status: 202 len: 0 microversion: 2.1 time: 0.778240 Aug 29 20:16:57.093565 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 181/377] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:16:56 2022] DELETE /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/os-volume_attachments/acfefc38-b5eb-40cf-ba9c-ae4a09e9e821 => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:16:57.117924 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:57.122364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:57.141980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:57.143197 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:57.144598 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:57.146174 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:57.147339 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:57.149165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:57.232706 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:57.248344 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c95537e5-03da-4da1-9337-5e708c92566a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.466679 Aug 29 20:16:57.252640 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 197/378] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:56 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:57.510502 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:57.524811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:57.527270 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:57.529492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-528adc76-c752-428a-b7bc-5a5de7f2c089 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.433432 Aug 29 20:16:57.530409 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 182/379] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:57 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:57.660489 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:57.662186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:57.681955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:57.682968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:57.684129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:57.685966 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:57.687174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:57.688477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:57.808051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:57.810425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:57.823390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:57.824671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:57.826584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:57.829054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:57.830397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:57.831462 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:57.954582 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:57.975907 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b24382f3-f950-491c-b54b-93bfb487a5d1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1260 microversion: 2.1 time: 0.321212 Aug 29 20:16:57.999128 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:58.003636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 198/380] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:57 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1260 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:58.012390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e5d825b2-68ea-4d59-b736-02f35451e709 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1219 microversion: 2.1 time: 0.212082 Aug 29 20:16:58.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 183/381] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:57 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:58.304101 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:58.305746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:58.316081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:58.316925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:58.317577 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:58.318554 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:58.323180 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:58.324516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:58.567026 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:58.570492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:58.602726 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:58.619879 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:58.623357 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:58.628482 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:58.630514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:58.631929 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:58.633475 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0028f01c-34b2-497c-a375-f2c9f35d78e4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.342760 Aug 29 20:16:58.633806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:58.635139 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 199/382] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:58 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:58.877143 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:58.894629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:58.898599 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:58.901193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-81ac2d7f-677b-4e83-9aa1-b91ddf607f17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.345774 Aug 29 20:16:58.902509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 184/383] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:58 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:59.013566 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:59.015358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:59.027385 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.027878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.028340 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.030710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.030710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.030710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.040605 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:59.042516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:59.055711 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.057126 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.058387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.060104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.061271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.062551 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.211773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:59.229350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-703efc1f-6cdf-4b6f-9031-06bf3a82db3d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1211 microversion: 2.1 time: 0.196334 Aug 29 20:16:59.231187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 185/384] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:59 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:59.354104 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:59.379604 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2917ae61-4529-4605-bc73-02e37da4369f tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1444 microversion: 2.1 time: 0.372312 Aug 29 20:16:59.380688 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 200/385] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:59 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1444 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:59.425528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:59.427080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:59.436959 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.437766 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.438553 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.439517 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.440204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.440856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.663090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:59.665573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:59.688302 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.689747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.693529 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.695340 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.698967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.700334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.769970 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:59.787283 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2672aa2a-3e19-4fdb-811b-4010d0c23f7d tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1444 microversion: 2.1 time: 0.371309 Aug 29 20:16:59.788647 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 186/386] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:59 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1444 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:59.936868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:59.938828 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:59.957540 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.961667 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.962835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.964685 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.971499 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:59.977945 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.979287 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.998816 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8f5c2bbc-4bc9-463f-be6c-dbb0aed2f8bc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.342593 Aug 29 20:17:00.007516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 201/387] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:16:59 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:00.274546 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:00.284044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:00.308674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:00.314150 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:00.316192 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:00.318034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:00.318538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:00.318979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:00.415587 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:00.421371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:00.432466 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:00.433984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:00.435211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-55e27c44-a972-4521-b639-9ae0637b698a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.502250 Aug 29 20:17:00.450901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 187/388] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:16:59 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:17:00.466589 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:00.477517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b6aeb725-7db7-480b-828d-33dd19f61ef3 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1267 microversion: 2.1 time: 0.220291 Aug 29 20:17:00.479186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 202/389] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:00 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:01.040141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:01.042377 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:01.064668 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:01.065465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:01.079477 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:01.081138 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:01.093654 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:01.094474 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:01.473144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:01.480775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:01.486453 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:01.499080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:01.500265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:01.501279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:01.503059 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:01.504180 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:01.505064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:01.505985 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6a0605b5-eadb-4c32-aea8-086702a73f29 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.472413 Aug 29 20:17:01.522596 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 188/390] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:01 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:01.531799 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:01.533400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:01.549670 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:01.550623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:01.551454 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:01.552825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:01.554265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:01.554878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:01.685535 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:01.697348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2190629e-9b26-4d91-a2e1-b72012b575e8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1267 microversion: 2.1 time: 0.172193 Aug 29 20:17:01.699275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 189/391] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:01 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:01.766398 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:01.783648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:01.785177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:01.786481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-940b8a95-9a0d-440d-9f25-9e06d0dd123e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.327671 Aug 29 20:17:01.802257 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 203/392] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:01 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:02.541960 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:02.543211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:02.567438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:02.568260 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:02.568982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:02.570202 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:02.570979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:02.571701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:02.727818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:02.730879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:02.763403 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:02.764505 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:02.765504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:02.768207 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:02.769267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:02.771880 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:02.975542 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:02.998561 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7ce3e774-b8d8-4e19-b4db-a54aca4af51d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1267 microversion: 2.1 time: 0.280587 Aug 29 20:17:03.021834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 204/393] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:02 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:03.040711 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:03.041460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:03.064019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:03.064624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:03.065221 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:03.066295 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:03.067312 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:03.068079 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:03.289523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:03.301360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:03.302895 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:03.304118 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2b7f579d-9331-44f9-9fbc-2e686067402a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.286479 Aug 29 20:17:03.304695 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 205/394] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:03 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:03.309625 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-50c5f9c7-2b53-49c6-b4a6-7f494576db0a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:03.338387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50c5f9c7-2b53-49c6-b4a6-7f494576db0a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:03.339002 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50c5f9c7-2b53-49c6-b4a6-7f494576db0a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:03.339441 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50c5f9c7-2b53-49c6-b4a6-7f494576db0a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:03.402910 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-50c5f9c7-2b53-49c6-b4a6-7f494576db0a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Going to try to stop instance {{(pid=120787) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 20:17:03.515103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-50c5f9c7-2b53-49c6-b4a6-7f494576db0a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/action" status: 202 len: 0 microversion: 2.1 time: 0.206281 Aug 29 20:17:03.519940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 206/395] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:17:03 2022] POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:17:03.526601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:03.527586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:03.536361 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:03.537190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:03.537864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:03.539026 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:03.539804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:03.540670 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:03.807227 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:03.819734 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-511be243-4095-4329-80a4-0abf4a2bf69e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 1.286950 Aug 29 20:17:03.825912 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 190/396] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:02 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:03.951017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:03.968863 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8a7a4813-09cd-45d8-bed5-88f1e5f7f467 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.446878 Aug 29 20:17:03.970724 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 207/397] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:03 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:04.044527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:04.046098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:04.057700 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.058497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.059039 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.059946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.060597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.061292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.205507 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:04.225110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d0bfe0a9-0bb8-4a95-9046-eaae4c39927c tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1267 microversion: 2.1 time: 0.188097 Aug 29 20:17:04.226690 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 191/398] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:04 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:04.272278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-a3f3546c-aab4-40c7-8e8e-7d396ae24267 req-77efd7e9-0df0-4ed6-8896-7827652d8527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9470292c-17d1-47bf-9ea3-c5b0eb069a12", "tag": "e83470af-1797-4000-830e-cdec3cee207b"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:04.318283 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a3f3546c-aab4-40c7-8e8e-7d396ae24267 req-77efd7e9-0df0-4ed6-8896-7827652d8527 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.320423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a3f3546c-aab4-40c7-8e8e-7d396ae24267 req-77efd7e9-0df0-4ed6-8896-7827652d8527 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.321645 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a3f3546c-aab4-40c7-8e8e-7d396ae24267 req-77efd7e9-0df0-4ed6-8896-7827652d8527 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.346200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:04.346820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:04.351357 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-a3f3546c-aab4-40c7-8e8e-7d396ae24267 req-77efd7e9-0df0-4ed6-8896-7827652d8527 service nova] Creating event network-changed:e83470af-1797-4000-830e-cdec3cee207b for instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 on hv-cinder-85426 Aug 29 20:17:04.363523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-a3f3546c-aab4-40c7-8e8e-7d396ae24267 req-77efd7e9-0df0-4ed6-8896-7827652d8527 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098011 Aug 29 20:17:04.369914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 208/399] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:04.372784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.373316 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.387165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.388328 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.389239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.390111 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.703889 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:04.713943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:04.715590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:04.716780 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dec591ee-03d5-4b4f-88d7-434c00635b6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.376830 Aug 29 20:17:04.729953 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 192/400] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:04 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:04.867678 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:04.869489 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:04.901558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.902308 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.902978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.904130 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.904945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.905727 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.996363 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:04.997251 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:05.012900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:05.013839 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:05.015429 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:05.017239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:05.018097 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:05.019242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:05.098621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:05.109833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d2454916-58ca-4507-93c0-ca69eff045db tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.261204 Aug 29 20:17:05.110996 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 209/401] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:04 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:05.278368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:05.279323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:05.285593 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:05.289243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:05.290038 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:05.290668 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:05.292494 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:05.293183 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:05.294058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:05.321610 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-496dcb0f-fbfc-4bf9-9f0d-a25fca5cfc13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.330486 Aug 29 20:17:05.323838 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 193/402] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:04 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:05.412860 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:05.428412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-49904207-5e24-4fcf-9837-28099334854b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1275 microversion: 2.1 time: 0.156544 Aug 29 20:17:05.442044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 210/403] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:05 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:05.752256 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:05.753210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:05.774494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:05.775249 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:05.775834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:05.776884 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:05.777567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:05.778210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.045883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.084320 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.112154 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.114762 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-099cdc1f-7f6a-4b9b-8f56-28bc26c7b9f3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.373510 Aug 29 20:17:06.116506 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 194/404] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:05 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:06.148021 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:06.149538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:06.162510 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:06.164681 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:06.166070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.167347 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:06.167568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:06.168460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.347594 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:06.348581 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:06.350759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:06.352369 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:06.375066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:06.376447 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:06.377562 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.378919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:06.380156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:06.380937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.452975 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.464414 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-37bba567-ac56-46de-b65d-1ba672b18170 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.327303 Aug 29 20:17:06.465902 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 211/405] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:06 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:06.473072 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:06.474345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:06.482986 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:06.483797 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:06.484393 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.485374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:06.486064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:06.486648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.571043 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.581695 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e769e88b-ced5-47d6-a57d-cd93fa0108ae tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1275 microversion: 2.1 time: 0.114347 Aug 29 20:17:06.582743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 212/406] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:06 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1275 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:06.644809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.657795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-34742e22-36dd-4a7e-a849-51ad9653401f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.314367 Aug 29 20:17:06.669747 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 195/407] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:06 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:07.158593 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:07.160655 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:07.164728 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:07.170180 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.170998 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.171838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.173653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.174490 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.175196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.207772 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:07.369844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:07.383438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:07.385597 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:07.386840 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c69002f0-7baf-4846-8849-9c27fd1b53e8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.233049 Aug 29 20:17:07.387408 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 213/408] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:07 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:17:07.502169 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:07.502739 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:07.514766 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.516250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.517205 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.518621 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.519344 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.520078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.608942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:07.610775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:07.623310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.624083 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.624867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.626660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.627484 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.628119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.736907 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:07.752948 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:07.754133 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-14567db7-d98e-45fe-bf15-08973197c074 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1275 microversion: 2.1 time: 0.150793 Aug 29 20:17:07.754721 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 214/409] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:07 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:07.761240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:07.762273 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:07.767171 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4265c6d7-feff-470f-b99c-7b86aa53b0b2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1736 microversion: 2.1 time: 0.270032 Aug 29 20:17:07.774431 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.774657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 196/410] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:07 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:07.776422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.776422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.777429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.778460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.781153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:08.014183 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:08.036636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-72255220-5c37-42d0-a1ea-6b364526d212 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.276051 Aug 29 20:17:08.046452 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 215/411] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:07 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:08.420854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:08.421467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:08.428537 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:08.429020 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:08.429482 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:08.430274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:08.433692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:08.434299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:08.655950 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:08.666700 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:08.668799 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:08.670371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c6a6a0dd-0b2d-4252-bce8-d2a495e1bba4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1738 microversion: 2.20 time: 0.254256 Aug 29 20:17:08.670967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 197/412] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:08 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:08.781865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:08.782952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:08.799096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:08.800193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:08.800595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:08.801201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:08.801514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:08.804218 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:08.804218 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:08.804218 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:08.814716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:08.814716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:08.815209 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:08.816600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:08.817046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:08.817492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:08.913776 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:08.930430 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7c8ae95f-aa02-4a58-a895-dc5a21c74d57 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1273 microversion: 2.1 time: 0.154157 Aug 29 20:17:08.931836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 216/413] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:08 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:09.064707 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:09.065449 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:09.075956 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.078166 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.079181 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.080102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.082135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.082135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.115864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:09.131553 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-74846292-3cdc-477a-982d-551d33fc3cb4 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1716 microversion: 2.1 time: 0.338393 Aug 29 20:17:09.133287 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 198/414] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:08 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1716 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:09.352023 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:09.352677 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:09.364182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.365391 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.366433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.367774 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.369569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.369569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.496693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] HTTP exception thrown: Cannot 'detach_volume' instance 06e26ac8-5eaa-4408-8208-b082661ea002 while it is in vm_state rescued Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Request method failure captured: Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments/d447c8eb-7f88-49c1-a274-ddc4b38067ce HTTP/1.1 Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR28w0cdbqbjUs7cPGu7Z3OpjfbycPDV81CmrJ2VVTtylWpySvnPIB1VScYNDbHLRzClVx9T9FNVGLsetYZRxK-OeEFHX2UT0dVXCTtnV8PQta4BG_v1Chna25Ls1ii1hIZxIMuA3GvqvqMgjb8d0H4ctp2OnlDzQgoj8Uo1iZRI7O8 Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:17:09.498410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bbb0263903e14938b44d9a6b430d84ce"}]}] Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: e75b537d44524de192282b10825293f9 Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:17:09.501120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Cannot 'detach_volume' instance 06e26ac8-5eaa-4408-8208-b082661ea002 while it is in vm_state rescued Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'server_id': '06e26ac8-5eaa-4408-8208-b082661ea002', 'id': 'd447c8eb-7f88-49c1-a274-ddc4b38067ce'} Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06e26ac8-5eaa-4408-8208-b082661ea002 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:17:09.502490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 06e26ac8-5eaa-4408-8208-b082661ea002 while it is in vm_state rescued Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 06e26ac8-5eaa-4408-8208-b082661ea002 while it is in vm_state rescued Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:17:09.503728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Returning 409 to user: Cannot 'detach_volume' instance 06e26ac8-5eaa-4408-8208-b082661ea002 while it is in vm_state rescued {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:17:09.504674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-71685a62-85fc-4d06-9488-924ced46bbc9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "DELETE /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments/d447c8eb-7f88-49c1-a274-ddc4b38067ce" status: 409 len: 152 microversion: 2.1 time: 0.157981 Aug 29 20:17:09.504674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 199/415] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:17:09 2022] DELETE /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments/d447c8eb-7f88-49c1-a274-ddc4b38067ce => generated 152 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 20:17:09.513406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:09.514351 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:09.530696 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.531460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.532913 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.533692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.537033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.537033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.655255 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aab08dec-bac3-4ee2-9b50-90dc43a6df9a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "POST /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/action" status: 202 len: 0 microversion: 2.1 time: 0.147184 Aug 29 20:17:09.660807 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 200/416] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:17:09 2022] POST /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:17:09.671094 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:09.672769 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:09.682823 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.683473 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.684462 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.684692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.685195 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.685623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.856726 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:09.867498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-423b0ecf-a7f1-4a80-955a-f1404deeb5b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.809643 Aug 29 20:17:09.868456 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 217/417] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:09 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:09.874746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:09.874746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:09.886235 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.887448 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.888106 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.889286 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.890121 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.892050 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.911266 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:09.929057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-91b77262-3bb2-4f8a-962b-06b8c1bb8da3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1724 microversion: 2.1 time: 0.264123 Aug 29 20:17:09.929057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 201/418] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:09 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:09.962268 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:09.963892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:09.975471 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.976348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.977233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.978674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:09.979743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:09.980593 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:10.114871 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:10.131626 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2979db24-2eab-4718-a82f-3dd9bd4769de tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1273 microversion: 2.1 time: 0.173509 Aug 29 20:17:10.134292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 202/419] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:09 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:10.186547 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:10.207266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:10.209643 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:10.211864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7fe8c413-4591-4062-a6b5-503471fff0ce tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1720 microversion: 2.20 time: 0.342022 Aug 29 20:17:10.221004 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 218/420] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:09 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1720 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:10.920225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:10.926470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:10.959002 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:10.961327 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:10.963682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:10.964619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:10.965886 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:10.968073 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:10.973530 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:10.975309 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:10.984423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:10.988936 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:10.989381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:10.990855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:10.995772 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:10.996497 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:11.042936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:11.426485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:11.444007 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7336c759-8cba-4f20-b941-13708aeca74b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1724 microversion: 2.1 time: 0.483635 Aug 29 20:17:11.461762 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 219/421] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:10 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1724 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:11.465531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:11.465531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:11.475467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:11.475796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:11.476667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:11.477776 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:11.478252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:11.478834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:11.664636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:11.675368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a4a4f64f-7d02-4416-878a-7bad06291447 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.778971 Aug 29 20:17:11.689762 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 203/422] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:10 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:11.689762 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:11.689762 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:11.699613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:11.700656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:11.702479 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:11.704133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:11.705036 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:11.705755 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:11.822928 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:11.839164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-17845014-8c6a-47f5-bd46-1eca44e12773 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.385727 Aug 29 20:17:11.840599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 220/423] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:11 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:12.245222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-500ac6e1-513c-4ff4-b422-72c9529fe883 req-dcbeb1e3-1b13-49b2-bd07-e6d043c0b293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "055081ad-325c-49db-addd-916c73e8f97d", "tag": "566ba202-c16d-40fa-bdd7-c85f8a1fd013"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:12.267475 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-500ac6e1-513c-4ff4-b422-72c9529fe883 req-dcbeb1e3-1b13-49b2-bd07-e6d043c0b293 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.269696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-500ac6e1-513c-4ff4-b422-72c9529fe883 req-dcbeb1e3-1b13-49b2-bd07-e6d043c0b293 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.270919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-500ac6e1-513c-4ff4-b422-72c9529fe883 req-dcbeb1e3-1b13-49b2-bd07-e6d043c0b293 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.327649 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-500ac6e1-513c-4ff4-b422-72c9529fe883 req-dcbeb1e3-1b13-49b2-bd07-e6d043c0b293 service nova] Creating event network-changed:566ba202-c16d-40fa-bdd7-c85f8a1fd013 for instance 055081ad-325c-49db-addd-916c73e8f97d on hv-cinder-85426 Aug 29 20:17:12.342584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-500ac6e1-513c-4ff4-b422-72c9529fe883 req-dcbeb1e3-1b13-49b2-bd07-e6d043c0b293 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107488 Aug 29 20:17:12.344171 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 221/424] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:17:12.499498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:12.505119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:12.533013 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.534338 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.535427 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.537613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.539358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.540299 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.572464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:12.588966 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:12.590464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:12.591757 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7ae22598-a4fb-4197-bf30-6b9f01861651 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1720 microversion: 2.20 time: 0.914840 Aug 29 20:17:12.592494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 204/425] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:11 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1720 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:12.701464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:12.702109 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:12.710550 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.711042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.711481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.712600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.712600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.717489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.787446 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:12.803853 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-02611066-19c7-45fc-9a39-a16b1c8954f6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1724 microversion: 2.1 time: 0.321494 Aug 29 20:17:12.805350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 222/426] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:12 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:12.871641 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:12.872381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:12.879271 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.879866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.880378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.881374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.881942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.882803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.980192 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:12.994487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-83f4bcab-4c2f-4b35-8563-43c8b65c00b4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.296807 Aug 29 20:17:12.996911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 205/427] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:12 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:13.035869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-d9d4bc47-a452-4e8e-8f64-3a03d778396a req-5495916f-382c-4db4-ac0a-e666da139ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86403f3-4482-4e27-9f97-cdf8fc2dd9ad", "name": "network-vif-unplugged", "status": "completed", "tag": "4c3e0080-8d58-44c1-8b13-e2b6f6549e47"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:13.052552 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d9d4bc47-a452-4e8e-8f64-3a03d778396a req-5495916f-382c-4db4-ac0a-e666da139ffc service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:13.053656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d9d4bc47-a452-4e8e-8f64-3a03d778396a req-5495916f-382c-4db4-ac0a-e666da139ffc service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:13.054272 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d9d4bc47-a452-4e8e-8f64-3a03d778396a req-5495916f-382c-4db4-ac0a-e666da139ffc service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:13.073549 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-d9d4bc47-a452-4e8e-8f64-3a03d778396a req-5495916f-382c-4db4-ac0a-e666da139ffc service nova] Creating event network-vif-unplugged:4c3e0080-8d58-44c1-8b13-e2b6f6549e47 for instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad on hv-cinder-85426 Aug 29 20:17:13.082657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-d9d4bc47-a452-4e8e-8f64-3a03d778396a req-5495916f-382c-4db4-ac0a-e666da139ffc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052290 Aug 29 20:17:13.083714 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 206/428] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:13.124970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:13.137444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-27f61657-1c71-413e-8572-9b4d6fe2a118 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.269979 Aug 29 20:17:13.138559 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 223/429] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:12 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:13.628944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:13.629654 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:13.636806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:13.637285 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:13.637731 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:13.638451 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:13.638900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:13.639316 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:13.803284 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:13.812748 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:13.815113 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:13.816968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eed84ca3-b746-4f0c-abc8-a9c266921bed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1720 microversion: 2.20 time: 0.193904 Aug 29 20:17:13.817827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 207/430] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:13 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:13.830193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:13.831158 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:13.838433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:13.838926 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:13.839366 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:13.840076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:13.840529 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:13.840982 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:14.004075 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:14.013885 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-43bfe39a-0f81-40d7-9178-00d305e90bf2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1724 microversion: 2.1 time: 0.188416 Aug 29 20:17:14.014698 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 224/431] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:13 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:14.026441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:14.027595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:14.041130 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:14.041791 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:14.042288 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:14.043107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:14.043736 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:14.044279 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:14.170269 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:14.171401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:14.181504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:14.182412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:14.183237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:14.184413 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:14.185138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:14.185846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:14.237184 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:14.246586 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-68c3323d-d33d-4898-b6b3-84c998351795 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.227852 Aug 29 20:17:14.247281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 208/432] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:14 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:14.348296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:14.359566 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-39eb90ed-9f47-4abd-a6f4-0466a481f57b tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.196121 Aug 29 20:17:14.360388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 225/433] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:14 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:14.845421 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:14.846435 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:14.853689 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:14.854421 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:14.855009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:14.856034 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:14.856583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:14.857247 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:15.020614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.029494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.030958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.032876 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-336405e8-11b4-4877-a467-de47bbe7ce49 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1720 microversion: 2.20 time: 0.193249 Aug 29 20:17:15.033615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 209/434] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:14 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:15.049284 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:15.050098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:15.057352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:15.057869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:15.058303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:15.059003 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:15.059452 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:15.059870 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:15.209979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.219770 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b660b2e6-8074-47d9-9fbe-784ccd4b6c82 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1724 microversion: 2.1 time: 0.174423 Aug 29 20:17:15.220640 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 226/435] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:15 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:15.273395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:15.274329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:15.285765 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:15.286796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:15.287351 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:15.288570 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:15.289382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:15.290162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:15.385052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:15.386083 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:15.394031 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:15.394572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:15.395076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:15.395832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:15.396603 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:15.397365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:15.443899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.453194 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dba4158f-4e96-4c3c-ada6-0b64ecc51f13 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.187321 Aug 29 20:17:15.454551 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 210/436] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:15 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:15.543177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.551818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-45aad945-f5a6-4a5b-b31e-d4b7f01a56bc tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.172954 Aug 29 20:17:15.552405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 227/437] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:15 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:16.062761 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:16.063493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:16.071898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.072382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.072826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.073531 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.074013 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.074437 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.227282 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.237444 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.239224 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.240652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cee95cab-945a-4786-ac5b-787285035699 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1720 microversion: 2.20 time: 0.181838 Aug 29 20:17:16.241623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 211/438] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:16 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:16.253764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:16.254909 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:16.267433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.268287 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.269086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.270442 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.271291 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.272047 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.457776 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.467820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cb76d6f1-e23d-4e4f-b739-8cb70d7478a3 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1724 microversion: 2.1 time: 0.223114 Aug 29 20:17:16.468726 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 228/439] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:16 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:16.480817 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:16.482110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:16.494943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.495829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.496635 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.497916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.498734 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.499509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.575447 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:16.576577 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:16.587194 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.588034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.588805 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.590090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.590884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.591595 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.702135 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.711448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-167c37b6-75a7-44fd-bd41-668628f1bcf5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.237751 Aug 29 20:17:16.712480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 212/440] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:16 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:16.799009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.814043 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b891fff0-e0d0-4dd3-aed2-42fa0c8525e1 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.242901 Aug 29 20:17:16.815092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 229/441] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:16 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:17.280779 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:17.281372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:17.288448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:17.288996 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:17.289461 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:17.290240 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:17.290725 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:17.291293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:17.451593 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:17.462398 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:17.464728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:17.466697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-26e18185-1dd3-4d14-8d19-96915096904a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1720 microversion: 2.20 time: 0.189994 Aug 29 20:17:17.467477 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 213/442] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:17 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:17:17.496755 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:17.497532 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:17.506301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:17.506787 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:17.507214 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:17.507914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:17.508362 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:17.508780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:17.695589 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:17.700839 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=100 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:17.710794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-499d0697-8571-4ae3-bf5a-7187b16fb5fe tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1724 microversion: 2.1 time: 0.217737 Aug 29 20:17:17.711740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 230/443] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:17 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:17.743667 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:17.744336 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:17.751558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:17.752040 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:17.752964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:17.753676 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:17.754184 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:17.754577 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:17.839093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:17.839093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:17.846199 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:17.846822 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:17.847487 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:17.848211 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:17.848667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:17.849098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:17.950218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:17.960126 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-defc0794-3acd-40c0-bad9-e6b36601970d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.220233 Aug 29 20:17:17.961203 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 214/444] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:17 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:18.030761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:18.045056 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6a6ace7a-187d-41cb-9343-085734dbd3e7 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.211425 Aug 29 20:17:18.046087 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 231/445] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:17 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:18.509792 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:18.510588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:18.520860 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:18.521580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:18.522562 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:18.523705 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:18.524438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:18.525178 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:18.733749 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:18.734934 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:18.742192 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:18.743750 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:18.744179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:18.745148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:18.745610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:18.746079 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:18.778893 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:18.793964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:18.796825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:18.799656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fc2ac0c1-c560-472a-91c0-5a868cabbc5e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1723 microversion: 2.20 time: 0.295318 Aug 29 20:17:18.800710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 215/446] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:18 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:18.835220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d1a1886-05c3-4d3e-95db-ceac7225ce7c"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:18.844063 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:18.848929 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:18.850141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:18.850141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:18.851476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:18.852359 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:18.853042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:18.963643 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:18.978976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0a7f7392-8fcb-40f9-a50d-138e5854180e tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1730 microversion: 2.1 time: 0.249250 Aug 29 20:17:18.979571 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 232/447] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:18 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:18.995859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:18.997099 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:19.008642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.009638 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.010539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.011849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.012686 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.013495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.228819 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:19.241917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2bd9a17d-bb9a-41d0-831a-c1049438a8f1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.253819 Aug 29 20:17:19.242429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 233/448] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:18 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:19.247976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:19.248473 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:19.259568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.260574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.262366 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.263365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.263967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.264621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.344713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7b510002-a263-4e55-9dae-baf4985cecbd tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.516577 Aug 29 20:17:19.345458 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 216/449] 10.222.0.73 () {62 vars in 1364 bytes} [Mon Aug 29 20:17:18 2022] POST /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments => generated 188 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:17:19.354415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:19.354415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:19.361081 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.361566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.362016 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.362809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.363501 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.364233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.389697 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ecd86262-a623-4c0d-934c-ec43ba62e553 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144775 Aug 29 20:17:19.392309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 234/450] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 29 20:17:19 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:19.550704 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:19.551307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:19.560387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.560931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.561452 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.562275 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.562793 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.563908 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.688926 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120787) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:17:19.721899 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=100 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:19.783376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:19.819426 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8926fec0-f1b9-49ae-8e14-d70237d432b0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.472289 Aug 29 20:17:19.820611 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 217/451] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:19 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:19.844353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9b1445ee-ef0c-4407-9a31-183954055284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/action" status: 202 len: 0 microversion: 2.20 time: 0.298933 Aug 29 20:17:19.845930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 235/452] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 29 20:17:19 2022] POST /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:19.858061 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:19.859746 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:19.867582 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:19.870869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.871718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.872527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.875070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:19.875070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:19.876139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:19.882735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:20.239715 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:20.257024 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:20.259909 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:20.262244 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f5e0769b-bc07-43f8-a8fe-29f3d775754e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1809 microversion: 2.20 time: 0.410432 Aug 29 20:17:20.263523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 218/453] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:19 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1809 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:20.283707 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:20.285279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:20.300185 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:20.301599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:20.304455 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:20.305675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:20.306339 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:20.307377 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:20.559619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:20.572291 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-faac4882-e0f6-4537-bbab-0595d6d9db94 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.304371 Aug 29 20:17:20.573223 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 236/454] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:20 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:20.850203 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:20.851050 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:20.863977 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:20.865525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:20.866452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:20.869304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:20.870783 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:20.871311 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:21.244874 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:21.269476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aa9d30e8-2e3e-4f2c-bf4c-0e701b782887 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.426025 Aug 29 20:17:21.270121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 219/455] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:20 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:21.306053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:21.306053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:21.314181 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:21.314418 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:21.315118 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:21.316079 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:21.316849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:21.317488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-2a8b2c6f-92f5-48db-aea7-f4ddccb4db99 req-4bb7f44c-2441-43dd-b5cc-5d5ab5a0efcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e26ac8-5eaa-4408-8208-b082661ea002", "tag": "c2122474-4565-44ec-986a-9646613e2d4e"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:21.317841 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:21.348704 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2a8b2c6f-92f5-48db-aea7-f4ddccb4db99 req-4bb7f44c-2441-43dd-b5cc-5d5ab5a0efcd service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:21.361283 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2a8b2c6f-92f5-48db-aea7-f4ddccb4db99 req-4bb7f44c-2441-43dd-b5cc-5d5ab5a0efcd service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:21.362070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2a8b2c6f-92f5-48db-aea7-f4ddccb4db99 req-4bb7f44c-2441-43dd-b5cc-5d5ab5a0efcd service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:21.413835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-2a8b2c6f-92f5-48db-aea7-f4ddccb4db99 req-4bb7f44c-2441-43dd-b5cc-5d5ab5a0efcd service nova] Creating event network-changed:c2122474-4565-44ec-986a-9646613e2d4e for instance 06e26ac8-5eaa-4408-8208-b082661ea002 on hv-cinder-85426 Aug 29 20:17:21.431586 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-2a8b2c6f-92f5-48db-aea7-f4ddccb4db99 req-4bb7f44c-2441-43dd-b5cc-5d5ab5a0efcd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116145 Aug 29 20:17:21.435102 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 220/456] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:21.608057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:21.610625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:21.633931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:21.642190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:21.643256 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:21.644557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:21.651908 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:21.652780 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:21.698318 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:21.718141 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:21.722666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:21.727227 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-92fd3d6d-ab92-4721-9126-7bff0b33eb11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1809 microversion: 2.20 time: 0.433564 Aug 29 20:17:21.729494 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 237/457] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:21 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1809 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:21.963446 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:21.974615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9de74f31-ca4f-4ca9-a6fb-1e2f9bbe69db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.374748 Aug 29 20:17:21.975199 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 221/458] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:21 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:22.303629 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:22.307187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:22.325977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:22.327120 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:22.327794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:22.328688 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:22.329252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:22.329911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:22.767998 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:22.774875 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:22.775996 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:22.785248 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-05b06968-731d-4522-81e8-e0440f7a6dd2 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.495372 Aug 29 20:17:22.797755 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 238/459] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:22 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:22.814619 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:22.827671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:22.830865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:22.832246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:22.838156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:22.839082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:23.001655 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:23.003852 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:23.023464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:23.023954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:23.024655 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:23.025794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:23.026410 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:23.027129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:23.068615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:23.085665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:23.097333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:23.099150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c727350f-2768-4167-ae1c-13712683f8c6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1751 microversion: 2.20 time: 0.333584 Aug 29 20:17:23.103603 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 222/460] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:22 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1751 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:23.385642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:23.404017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2b166830-ed9c-4a2a-b411-4c98e20b7156 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.407946 Aug 29 20:17:23.405453 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 239/461] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:22 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:23.451835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-4ae14867-d592-4afa-9663-f99495267b96 req-443bfa18-982a-424c-a017-2b559dc962ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e26ac8-5eaa-4408-8208-b082661ea002", "tag": "c2122474-4565-44ec-986a-9646613e2d4e"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:23.465673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4ae14867-d592-4afa-9663-f99495267b96 req-443bfa18-982a-424c-a017-2b559dc962ae service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:23.466904 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4ae14867-d592-4afa-9663-f99495267b96 req-443bfa18-982a-424c-a017-2b559dc962ae service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:23.467539 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4ae14867-d592-4afa-9663-f99495267b96 req-443bfa18-982a-424c-a017-2b559dc962ae service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:23.490782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-4ae14867-d592-4afa-9663-f99495267b96 req-443bfa18-982a-424c-a017-2b559dc962ae service nova] Creating event network-changed:c2122474-4565-44ec-986a-9646613e2d4e for instance 06e26ac8-5eaa-4408-8208-b082661ea002 on hv-cinder-85426 Aug 29 20:17:23.500724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-4ae14867-d592-4afa-9663-f99495267b96 req-443bfa18-982a-424c-a017-2b559dc962ae service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054546 Aug 29 20:17:23.501494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 223/462] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:17:23.827301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:23.827939 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:23.834743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:23.835495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:23.836114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:23.836850 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:23.837581 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:23.838312 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:24.083932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:24.098280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8726bf78-103f-4b58-9a6a-1e6efde077c0 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.274752 Aug 29 20:17:24.099349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 240/463] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:23 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:24.138177 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:24.139674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:24.148006 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:24.148864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:24.149513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:24.150541 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:24.151366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:24.152312 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:24.402981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:24.417614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:24.419143 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:24.420626 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-20e63a3f-2792-4791-8aec-7f4e894341bb tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.288610 Aug 29 20:17:24.421457 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 224/464] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:24 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:24.440038 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:24.440771 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:24.447693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:24.448461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:24.449359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:24.450401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:24.451125 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:24.452029 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:24.865170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:24.879775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1debe0f3-6076-44fd-a9c1-617485ba0f48 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.443917 Aug 29 20:17:24.880650 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 241/465] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:24 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:25.123139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:25.123646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:25.139210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:25.139863 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:25.140273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:25.141141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:25.142430 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:25.142848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:25.443480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:25.454803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:25.455425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:25.471801 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f08721d6-d1ac-46e3-bc82-6e2a76e85a79 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.354908 Aug 29 20:17:25.472395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 225/466] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:25 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:25.477662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:25.478208 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:25.478853 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:25.480163 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:25.480812 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:25.481509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:25.677760 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-a22e71f5-7138-4d01-8ff7-a48731766b35 req-f25474e6-b03e-4e4e-b8d3-27cfe460c6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055081ad-325c-49db-addd-916c73e8f97d", "name": "network-vif-plugged", "status": "completed", "tag": "566ba202-c16d-40fa-bdd7-c85f8a1fd013"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:25.707066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a22e71f5-7138-4d01-8ff7-a48731766b35 req-f25474e6-b03e-4e4e-b8d3-27cfe460c6de service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:25.707784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a22e71f5-7138-4d01-8ff7-a48731766b35 req-f25474e6-b03e-4e4e-b8d3-27cfe460c6de service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:25.708657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a22e71f5-7138-4d01-8ff7-a48731766b35 req-f25474e6-b03e-4e4e-b8d3-27cfe460c6de service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:25.730452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-a22e71f5-7138-4d01-8ff7-a48731766b35 req-f25474e6-b03e-4e4e-b8d3-27cfe460c6de service nova] Creating event network-vif-plugged:566ba202-c16d-40fa-bdd7-c85f8a1fd013 for instance 055081ad-325c-49db-addd-916c73e8f97d on hv-cinder-85426 Aug 29 20:17:25.738818 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-a22e71f5-7138-4d01-8ff7-a48731766b35 req-f25474e6-b03e-4e4e-b8d3-27cfe460c6de service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067482 Aug 29 20:17:25.740383 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 226/467] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:25.741095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:25.760044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:25.762736 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:25.764679 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9346e603-cada-4801-9212-fb89f223decf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.318048 Aug 29 20:17:25.766024 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 242/468] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:25 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:17:25.915042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:25.916121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:25.924208 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:25.924864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:25.925418 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:25.926423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:25.926958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:25.927485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:26.424475 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:26.434002 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7d0b2ceb-7c2c-4daf-a866-5f0a29564592 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.523167 Aug 29 20:17:26.434593 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 227/469] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:25 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:26.503907 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:26.504756 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:26.512049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:26.512748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:26.513436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:26.514422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:26.514977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:26.515604 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:26.694072 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:26.709164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b2bc989b-3e37-4a9f-8e38-0ceb0aac30d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.208766 Aug 29 20:17:26.710278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 243/470] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:26 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:26.790701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:26.791298 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:26.800669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:26.801525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:26.802076 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:26.803053 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:26.804199 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:26.804656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:27.015128 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:27.029353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:27.030826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:27.032032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-87c0d683-7505-44b9-95cc-3ffc38810552 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.245353 Aug 29 20:17:27.032589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 228/471] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:26 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:27.459089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:27.459606 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:27.465921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:27.466413 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:27.466847 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:27.467550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:27.468003 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:27.468422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:27.614383 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:27.622523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a34a9d1f-5d30-4c59-baf7-dab0d633368a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.168046 Aug 29 20:17:27.623120 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 244/472] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:27 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:27.738083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:27.738959 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:27.745246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:27.745915 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:27.746589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:27.747508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:27.748175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:27.748641 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:27.893317 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:27.901510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9a32280e-a3df-47af-ae83-cf6deda4f106 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.168116 Aug 29 20:17:27.902127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 229/473] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:27 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:28.059262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:28.059778 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:28.067262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:28.067835 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:28.068330 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:28.069078 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:28.069617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:28.070165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:28.230674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:28.248464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:28.252449 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:28.254687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-95c61b08-6caf-45a3-be2f-70936cdbe370 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.199167 Aug 29 20:17:28.255668 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 245/474] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:28 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:28.645274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:28.646156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:28.652432 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:28.652917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:28.653401 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:28.654185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:28.654668 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:28.655098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:28.836760 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:28.845111 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a1635cdf-3cde-44a0-a340-8e727ec2677f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.204423 Aug 29 20:17:28.845693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 230/475] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:28 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:28.926360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:28.927111 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:28.933850 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:28.934324 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:28.934746 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:28.935738 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:28.936195 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:28.936608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:29.109639 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:29.116097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:29.126726 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6e711271-b287-4808-bfd1-70930625df35 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.204969 Aug 29 20:17:29.128175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 246/476] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:28 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:29.287871 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:29.288740 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:29.296423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:29.297104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:29.298395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:29.299597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:29.300151 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:29.300791 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:29.488120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:29.497686 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:29.499157 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:29.500340 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3c6c894c-11d2-440f-9c40-0e5157a0aa42 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.219278 Aug 29 20:17:29.501555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 231/477] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:29 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:29.867386 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:29.867995 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:29.875258 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:29.875917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:29.876379 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:29.877157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:29.877538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:29.877994 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:30.068932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:30.080857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9dcba4a6-cf08-478d-8b6c-7306c2d9a15b tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1675 microversion: 2.1 time: 0.217227 Aug 29 20:17:30.081918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 247/478] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:29 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:30.166186 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:30.168576 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:30.178857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:30.179315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:30.179931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:30.180949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:30.181627 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:30.182298 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:30.372388 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:30.387026 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7da814c9-9d9e-4235-9b3f-a6951fdb3073 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1315 microversion: 2.1 time: 0.233040 Aug 29 20:17:30.388211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 232/479] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:30 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:30.532415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:30.533335 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:30.541940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:30.542429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:30.543052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:30.544064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:30.544844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:30.545548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:30.727500 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:30.743251 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:30.745877 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:30.747892 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-fc3b0404-c07c-45f9-9071-3d71be949347 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.220942 Aug 29 20:17:30.748932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 248/480] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:30 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:31.109398 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:31.110410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:31.118417 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.119243 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.119620 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.120383 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.120905 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.121459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.410646 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:31.412040 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:31.420263 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.420972 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.421513 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.422959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.423487 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.424187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.632331 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:31.642356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:31.645111 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0b781f81-1487-4b36-917c-995cef747a96 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1652 microversion: 2.1 time: 0.540513 Aug 29 20:17:31.646080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 233/481] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:31 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1652 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:31.658008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-19ed0b03-7f5f-4e7e-ba5c-adbc40d1b877 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1465 microversion: 2.1 time: 0.250669 Aug 29 20:17:31.660949 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 249/482] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:31 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1465 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:31.675929 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ad9b01f3-f4fe-490d-bb14-8478a20d2276 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:31.683521 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad9b01f3-f4fe-490d-bb14-8478a20d2276 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.684291 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad9b01f3-f4fe-490d-bb14-8478a20d2276 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.684788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad9b01f3-f4fe-490d-bb14-8478a20d2276 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.730613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:31.731519 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:31.743778 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.744990 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.745784 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.747380 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.748505 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.750006 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.788069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ad9b01f3-f4fe-490d-bb14-8478a20d2276 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Going to try to start instance {{(pid=120788) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 20:17:31.794931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:17:31.870792 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ad9b01f3-f4fe-490d-bb14-8478a20d2276 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/action" status: 202 len: 0 microversion: 2.1 time: 0.199102 Aug 29 20:17:31.874647 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 234/483] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:17:31 2022] POST /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:17:31.881981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:31.881981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:31.888483 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.889424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.890055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.890954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.892974 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.893568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.933167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-71809597-0fb5-4e20-98ea-52f506f8759d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "DELETE /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 204 len: 0 microversion: 2.1 time: 0.206856 Aug 29 20:17:31.934822 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 250/484] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:17:31 2022] DELETE /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:31.941547 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:31.942283 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:31.948688 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.949462 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.949980 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:31.950834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:31.951309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:31.951716 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:32.059708 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:32.064098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:32.071837 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:32.073653 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:32.075157 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4bbbfa5a-16e4-48f1-9e36-fda7f4e49af1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.202369 Aug 29 20:17:32.075882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 235/485] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:31 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:32.086002 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:32.089545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:32.100751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:32.101887 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:32.102916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:32.104736 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:32.105521 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:32.106165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:32.230796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:32.243541 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-aa9ed203-7fc6-4f7b-b93c-5eefcb871967 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.306697 Aug 29 20:17:32.244543 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 251/486] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:31 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:32.300959 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:32.310104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ad6c618a-2e9c-49d4-a123-6cb4e5a13257 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.232484 Aug 29 20:17:32.310688 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 236/487] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:32 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:33.119954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:33.121054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:33.132488 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.133342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.134141 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.135351 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.136155 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.136907 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.276918 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:33.277646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:33.285931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.286413 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.286848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.287565 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.287997 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.288413 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.301447 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:33.311332 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:33.312847 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:33.315288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1d65215f-669e-4350-b03c-07bfd3027bc4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.202899 Aug 29 20:17:33.316196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 252/488] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:33 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:33.343012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:33.345046 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:33.351734 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.353531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.353531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.354063 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.354625 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.355155 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.470487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:33.488253 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2c678e3f-8737-4f2b-89e4-1a0464f90fe0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.215385 Aug 29 20:17:33.488851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 237/489] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:33 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:33.558922 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:33.571630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-25751514-2020-481d-b60c-018f23fafa2e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.232525 Aug 29 20:17:33.572345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 253/490] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:33 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:34.346513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:34.348617 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:34.359868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:34.361795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:34.361795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:34.363095 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:34.363964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:34.364712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:34.515913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:34.517183 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:34.529134 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:34.530054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:34.530609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:34.531506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:34.532082 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:34.532602 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:34.620286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:34.630026 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:34.631835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:34.632798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-54214443-7174-4243-9d33-ffc567e9e8a7 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.294149 Aug 29 20:17:34.633435 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 238/491] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:34 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:34.638553 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:34.639431 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:34.650166 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:34.651376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:34.652015 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:34.652917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:34.653563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:34.654218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:34.750068 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:34.775816 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-50ca9a6f-ecb3-48c6-8a36-2272ed1902b1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.267364 Aug 29 20:17:34.777036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 254/492] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:34 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:34.874385 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:34.884835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a3dcf71d-a0cd-430a-bea7-cd4e9196cc7e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.250066 Aug 29 20:17:34.885474 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 239/493] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:34 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:35.667105 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:35.669744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:35.678471 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:35.679042 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:35.679606 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:35.680476 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:35.681238 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:35.681964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:35.812979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:35.814615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:35.822809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:35.823853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:35.824695 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:35.826114 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:35.827299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:35.828306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:36.011674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:36.034753 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:36.036713 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:36.038990 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c21a78e2-7804-498f-835b-0c3f46e9d03f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.377208 Aug 29 20:17:36.049857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 255/494] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:35 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:36.054550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:36.059073 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:36.072152 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:36.073583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:36.074740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:36.076378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:36.077292 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:36.078074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:36.141776 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:36.155579 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-52d8b058-58c1-4c3a-9ca1-bebe797cac76 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.345254 Aug 29 20:17:36.156783 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 240/495] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:35 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:36.326051 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:36.338386 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3a5d84d6-fba0-42e5-b17c-c1ac2b8aa6d6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.296459 Aug 29 20:17:36.339569 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 256/496] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:36 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:37.087749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:37.088867 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:37.100592 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.101318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.102046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.103141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.103788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.104354 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.193032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:37.194617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:37.205728 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.206963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.207691 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.208934 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.210240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.210911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.322095 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:37.334108 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:37.337484 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:37.339365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d7bcfa23-7d72-439e-8476-7542834bef6a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.257525 Aug 29 20:17:37.340642 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 241/497] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:37 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:37.369384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:37.370526 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:37.378318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.379101 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.379721 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.380712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.381356 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.381975 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.452906 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:37.469530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a8a8a087-3b1d-4cd0-9d61-a13580a3fb2c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.280892 Aug 29 20:17:37.471700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 257/498] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:37 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:37.618348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:37.632741 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d8465018-5cb7-4c01-946d-bcb902e9059a tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.266986 Aug 29 20:17:37.645183 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 242/499] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:37 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:38.379366 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:38.380044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:38.387471 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:38.388064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:38.388672 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:38.389694 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:38.390377 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:38.392111 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:38.512248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:38.513323 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:38.525433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:38.526604 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:38.527364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:38.528608 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:38.529419 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:38.530286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:38.615978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:38.631138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:38.633459 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:38.635525 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ce2e484b-b900-4f79-92b6-c79bd1286452 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.260412 Aug 29 20:17:38.636589 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 258/500] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:38 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:38.662170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:38.663242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:38.670994 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:38.671910 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:38.672371 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:38.673320 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:38.673823 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:38.674503 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:38.772472 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:38.790290 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c083eca3-bda6-4145-97e6-5d7441a9c7e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.283362 Aug 29 20:17:38.791734 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 243/501] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:38 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:38.899681 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:38.911283 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bb12221d-7848-4d9f-ae47-74f607b13630 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.255096 Aug 29 20:17:38.912405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 259/502] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:38 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:39.679580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:39.680527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:39.688179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:39.689594 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:39.690375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:39.691483 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:39.692159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:39.692798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:39.817500 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:39.818145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:39.828085 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:39.829523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:39.830088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:39.830984 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:39.831578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:39.832266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:39.900921 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:39.919376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:39.922508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:39.925773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7ff9b2d1-6160-4ed1-a46b-3be64d992642 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.250349 Aug 29 20:17:39.926423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 244/503] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:39 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:39.962780 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:39.963989 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:39.975949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:39.977049 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:39.977764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:39.979034 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:39.979895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:39.980718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:40.065662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:40.081146 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e0a77873-52a7-409a-8efa-5d86836743da tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.268341 Aug 29 20:17:40.085773 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 260/504] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:39 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:40.222018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:40.241547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8df086dc-5d70-4cd8-8d40-e6a646592d6e tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.286289 Aug 29 20:17:40.242456 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 245/505] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:39 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:40.968164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:40.969177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:40.976032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:40.976562 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:40.977000 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:40.977782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:40.978291 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:40.978718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:41.114218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:41.115316 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:41.128411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:41.129248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:41.130032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:41.131262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:41.132161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:41.133075 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:41.267709 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:41.271743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:41.282958 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:41.285922 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:41.302148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8d9660b4-605f-4952-b572-e4b67208a744 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.339900 Aug 29 20:17:41.303022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 261/506] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:40 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:41.313222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:41.314964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:41.324406 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:41.324877 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:41.325326 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:41.326202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:41.326676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:41.327117 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:41.517171 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:41.532113 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cc38cd06-b936-4b92-9659-1be19312262d tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.423353 Aug 29 20:17:41.540643 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 246/507] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:41 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:41.632776 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:41.647465 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-79b8e05b-7513-42e4-a8c4-505263724475 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.343066 Aug 29 20:17:41.648619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 262/508] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:41 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:42.331492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:42.333440 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:42.346591 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:42.348087 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:42.349510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:42.351374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:42.352443 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:42.353427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:42.570918 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:42.594073 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:42.596199 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:42.597411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-225e79d6-3cbf-4298-85c8-aff6e39f40d3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.274039 Aug 29 20:17:42.598012 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 247/509] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:42 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:42.720755 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:42.724050 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:42.734303 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:42.734801 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:42.736450 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:42.736450 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:42.736693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:42.736988 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:42.772631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:42.773954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:42.793147 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:42.794045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:42.794656 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:42.796473 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:42.797534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:42.801410 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:42.960448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:42.968978 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6efd8119-bee2-4999-be44-880cd8b72376 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.276860 Aug 29 20:17:42.969614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 248/510] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:42 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:43.028251 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:43.038162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-34d5d6df-13a0-4e93-bf39-4c78a4436aec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.477406 Aug 29 20:17:43.038719 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 263/511] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:42 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:43.624297 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:43.625296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:43.633023 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:43.633501 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:43.634317 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:43.635025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:43.635476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:43.636063 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:43.883392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:43.910196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:43.914181 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:43.916331 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7c3c9cbf-b125-4761-a373-7a822b5a1f6c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.297209 Aug 29 20:17:43.929782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 249/512] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:43 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:44.001623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:44.002478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:44.010536 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:44.010969 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:44.011402 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:44.012094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:44.012577 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:44.012991 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:44.089778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:44.089778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:44.101797 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:44.102790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:44.103572 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:44.104847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:44.106058 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:44.106813 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:44.224617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:44.232889 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-eb76de1d-bb71-47de-97ee-7920d5f18d55 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.240466 Aug 29 20:17:44.233816 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 264/513] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:43 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:44.346933 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:44.355651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-187aa8b5-21d5-4886-a775-7ee543a85087 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.282614 Aug 29 20:17:44.356600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 250/514] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:44 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:44.946982 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:44.947744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:44.957632 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:44.958676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:44.959610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:44.961035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:44.962144 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:44.963017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:45.226065 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:45.235599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:45.237065 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:45.238304 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1099df9d-8e86-4f3a-8b12-20c4fd0392e4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.297228 Aug 29 20:17:45.239433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 265/515] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:44 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:17:45.264085 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:45.264951 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:45.273079 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:45.273732 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:45.274478 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:45.275376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:45.276155 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:45.276986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:45.380578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:45.381821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:45.389096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:45.390181 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:45.390993 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:45.393023 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:45.394007 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:45.394784 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:45.494771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:45.510202 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8b8eda87-7ecb-4520-97a0-c27bcceff571 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.250493 Aug 29 20:17:45.512017 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 251/516] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:45 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:45.651295 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:45.662614 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dcba34fd-2cb4-44ac-8f68-f3d4d7a45394 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.287949 Aug 29 20:17:45.663376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 266/517] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:45 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:46.279362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:46.280468 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:46.288227 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:46.288718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:46.289151 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:46.290001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:46.290464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:46.290887 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:46.314455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:46.464019 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:46.474020 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:46.475448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:46.476592 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-46ef7af9-5b10-4823-98d0-5229b499643f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.203398 Aug 29 20:17:46.477153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 252/518] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:46 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:46.538765 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:46.539412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:46.546092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:46.546586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:46.547019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:46.547723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:46.548356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:46.549102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:46.689293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:46.690397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:46.697449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:46.697963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:46.698389 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:46.699095 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:46.699901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:46.700650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:46.719545 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:46.728268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0f826b39-0222-4f9e-8ea2-9d6c405fb19f tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.193691 Aug 29 20:17:46.728853 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 267/519] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:46 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:46.856678 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:46.867966 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-64741ecb-45fe-428a-a100-0455db23dcc8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.183162 Aug 29 20:17:46.868561 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 253/520] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:46 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:47.500417 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:47.501309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:47.508303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:47.508792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:47.509273 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:47.509950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:47.510460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:47.510808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:47.698114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:47.709829 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:47.711358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:47.712482 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-90b4348d-ec17-41dd-ac11-bcee4821edf8 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.216528 Aug 29 20:17:47.713039 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 268/521] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:47 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:47.751970 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:47.753159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:47.760911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:47.761503 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:47.762040 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:47.762756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:47.763211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:47.763721 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:47.895629 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:47.896790 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:47.913867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:47.914729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:47.915436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:47.917051 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:47.917944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:47.918938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:47.970901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:47.979628 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d1f5e717-6c15-4bfa-834e-7da937f9d39d tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.233218 Aug 29 20:17:47.980518 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 254/522] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:47 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:48.100552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:48.120236 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-22f499b2-fab7-438b-a04e-95c4a348091f tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.232246 Aug 29 20:17:48.121550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 269/523] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:47 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:48.741139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:48.741960 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:48.748924 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:48.749457 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:48.750233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:48.752004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:48.752821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:48.753836 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.004642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:49.005665 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:49.011144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:49.015858 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.016149 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.016487 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.017271 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.017820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.018764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.024838 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:49.027555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:49.029175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3c123bd8-1567-48c6-8942-9f00fb66d3a9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.294780 Aug 29 20:17:49.046399 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 255/524] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:48 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:49.146825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:49.147681 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:49.158361 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.160719 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.161901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.163055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.163996 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.164659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.224308 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:49.235367 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-95b8f32b-c858-4c6c-94f8-4e0b54f7dbc6 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.235686 Aug 29 20:17:49.236886 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 270/525] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:48 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:49.581114 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:49.610906 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a48daf90-4225-46f1-95b1-2b9f168d96a1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.470102 Aug 29 20:17:49.611936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 256/526] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:49 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:50.068042 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:50.069067 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:50.073161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:50.098068 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.098981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.099768 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.101036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.101890 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.102626 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.267489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:50.268546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:50.272038 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=78 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:50.278555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.279395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.280149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.281965 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.283652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.283652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.589445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:50.611027 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-98d915bf-1122-489b-9a57-f832b33abcb8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1471 microversion: 2.1 time: 0.350994 Aug 29 20:17:50.614625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 257/527] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:50 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1471 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:50.646370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:50.654145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:50.662957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.664084 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.664795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.665782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.666474 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.667408 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.713515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:50.728154 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:50.732846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:50.735008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0ffd38f1-beb5-47f8-bcaa-cc792218b6c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.674304 Aug 29 20:17:50.737633 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 271/528] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:50 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:50.959044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:50.970184 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7e8b0ee8-e000-4c69-bcfb-35a5cda794ec tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.331017 Aug 29 20:17:50.972246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 258/529] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:50 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:51.639558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:51.641132 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:51.650882 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:51.651394 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:51.651834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:51.652609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:51.653070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:51.653501 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:51.763463 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:51.764695 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:51.773583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:51.774455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:51.775070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:51.775986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:51.776629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:51.777213 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:52.120664 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:52.141634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ad05d796-ad85-4c7a-bafa-699a8ac546d4 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1429 microversion: 2.1 time: 0.508109 Aug 29 20:17:52.154965 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 272/530] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:51 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1429 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:52.165844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:52.167489 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:52.196246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:52.197612 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:52.198851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:52.200414 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:52.201634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:52.202705 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:52.242545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:52.262133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:52.279268 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:52.281046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2655087a-c4d8-4d29-967b-dfaefaecd80a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.521539 Aug 29 20:17:52.303531 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 259/531] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:51 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:52.386943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-2ed12a78-5ebd-4c89-b0c7-1b418d3697b2 req-1d0e685e-6b14-43e6-8498-925ee97bb9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055081ad-325c-49db-addd-916c73e8f97d", "name": "network-vif-deleted", "tag": "566ba202-c16d-40fa-bdd7-c85f8a1fd013"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:52.406655 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2ed12a78-5ebd-4c89-b0c7-1b418d3697b2 req-1d0e685e-6b14-43e6-8498-925ee97bb9f4 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:52.407140 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2ed12a78-5ebd-4c89-b0c7-1b418d3697b2 req-1d0e685e-6b14-43e6-8498-925ee97bb9f4 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:52.407611 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2ed12a78-5ebd-4c89-b0c7-1b418d3697b2 req-1d0e685e-6b14-43e6-8498-925ee97bb9f4 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:52.438110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-2ed12a78-5ebd-4c89-b0c7-1b418d3697b2 req-1d0e685e-6b14-43e6-8498-925ee97bb9f4 service nova] Creating event network-vif-deleted:566ba202-c16d-40fa-bdd7-c85f8a1fd013 for instance 055081ad-325c-49db-addd-916c73e8f97d on hv-cinder-85426 Aug 29 20:17:52.448457 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-2ed12a78-5ebd-4c89-b0c7-1b418d3697b2 req-1d0e685e-6b14-43e6-8498-925ee97bb9f4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065462 Aug 29 20:17:52.449181 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 260/532] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:17:52.603466 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:52.615672 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-628eed2e-7dad-4c55-a882-69515989c1e8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.459000 Aug 29 20:17:52.632676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 273/533] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:52 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:53.191528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:53.195908 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:53.211741 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.213134 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.214259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.215826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.217065 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.218176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.277589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.278409 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.279107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.279731 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lazy-loading 'fault' on Instance uuid 055081ad-325c-49db-addd-916c73e8f97d {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:17:53.325444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:53.326835 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:53.335950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.336588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.337122 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.338070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.338659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.339158 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.368459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:53.378415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-67fdd616-c61f-4fb4-b02f-b91c50207652 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1305 microversion: 2.1 time: 0.197789 Aug 29 20:17:53.381762 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 261/534] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:53 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1305 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:53.649368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:53.650822 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:53.651035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:53.659331 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.660114 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.660557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.661440 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.661946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.662371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.669234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:53.671700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:53.674590 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-40527d7f-e843-49db-b111-859cc2fa66d6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.353999 Aug 29 20:17:53.676102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 274/535] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:53 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:53.865007 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:53.878158 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-00c17c76-1d44-4c82-a2fb-fba8ff9e582a tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1661 microversion: 2.1 time: 0.240901 Aug 29 20:17:53.890828 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 262/536] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:53 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1661 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:54.379054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-5889ff9e-a855-48f5-816c-36056177680c req-0f8736e0-5670-4eb4-bc3a-f6b76568e717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86403f3-4482-4e27-9f97-cdf8fc2dd9ad", "name": "network-vif-plugged", "status": "completed", "tag": "4c3e0080-8d58-44c1-8b13-e2b6f6549e47"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:54.408379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:54.409669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:54.414101 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-5889ff9e-a855-48f5-816c-36056177680c req-0f8736e0-5670-4eb4-bc3a-f6b76568e717 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.414832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-5889ff9e-a855-48f5-816c-36056177680c req-0f8736e0-5670-4eb4-bc3a-f6b76568e717 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.415501 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-5889ff9e-a855-48f5-816c-36056177680c req-0f8736e0-5670-4eb4-bc3a-f6b76568e717 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.442172 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.443854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.447804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.450298 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.455606 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.459998 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.473465 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-5889ff9e-a855-48f5-816c-36056177680c req-0f8736e0-5670-4eb4-bc3a-f6b76568e717 service nova] Creating event network-vif-plugged:4c3e0080-8d58-44c1-8b13-e2b6f6549e47 for instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad on hv-cinder-85426 Aug 29 20:17:54.492596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-5889ff9e-a855-48f5-816c-36056177680c req-0f8736e0-5670-4eb4-bc3a-f6b76568e717 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119807 Aug 29 20:17:54.498137 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 275/537] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:54.557227 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.558354 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.559560 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.560501 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lazy-loading 'fault' on Instance uuid 055081ad-325c-49db-addd-916c73e8f97d {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:17:54.636347 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41427ee7f3a4b478f5587b41a3b9e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6e748b13ea4fc5ad88eaee50ffa437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:54.644813 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6609810d-3e96-4115-aa24-05f204edd1e5 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 200 len: 1305 microversion: 2.1 time: 0.243242 Aug 29 20:17:54.645436 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 263/538] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:54 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 1305 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:54.709182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:54.710261 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:54.717037 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.717650 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.718178 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.719156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.719623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.720800 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.915384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:54.916375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:54.924344 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.925238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.925919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.926963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.927646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.928313 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.935720 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:54.955422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:54.960086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:54.963583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1ec6928b-f414-47eb-aff4-4a29bdf40fcc tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.261209 Aug 29 20:17:54.965060 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 276/539] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:54 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:55.241608 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:55.256940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a0952092-b62b-40f7-954b-25844acd890c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1665 microversion: 2.1 time: 0.348422 Aug 29 20:17:55.270421 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 264/540] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:54 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1665 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:55.682116 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:55.684253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] [instance: 055081ad-325c-49db-addd-916c73e8f97d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:55.699971 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:55.701270 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:55.702516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:55.704036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:55.705897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:55.706805 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:55.740756 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] HTTP exception thrown: Instance 055081ad-325c-49db-addd-916c73e8f97d could not be found. Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Request method failure captured: Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d HTTP/1.1 Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR6zGZ1eMtHGbpFljpYDk7Z73ZgHHV7ryNgQySaMIHjbpMf5-eYkmh0eXvjWrLAdxkK9B33R8ivxoStNfE8ypwovhmry1QjEGU8Dkk0-ozX1rX5AHDrkeYYVmHdM9in8_wTeoDUWiYWtD1noqeIWB4dzLzOT8uzhZD7AIikb0E5uxKU Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 1b6e748b13ea4fc5ad88eaee50ffa437 Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesNegativeTest-380584670 Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:17:55.744515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b6e748b13ea4fc5ad88eaee50ffa437"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b6e748b13ea4fc5ad88eaee50ffa437"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1b6e748b13ea4fc5ad88eaee50ffa437"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1b6e748b13ea4fc5ad88eaee50ffa437"}]}] Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesNegativeTest-380584670 Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 1b6e748b13ea4fc5ad88eaee50ffa437 Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesNegativeTest-380584670 Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesNegativeTest-380584670-project Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: b41427ee7f3a4b478f5587b41a3b9e5e Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesNegativeTest-380584670-project Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 055081ad-325c-49db-addd-916c73e8f97d could not be found. Aug 29 20:17:55.747560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '055081ad-325c-49db-addd-916c73e8f97d'} Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 055081ad-325c-49db-addd-916c73e8f97d could not be found. Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:17:55.749334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 055081ad-325c-49db-addd-916c73e8f97d could not be found. Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 055081ad-325c-49db-addd-916c73e8f97d could not be found. Aug 29 20:17:55.752588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:17:55.755509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] Returning 404 to user: Instance 055081ad-325c-49db-addd-916c73e8f97d could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:17:55.755509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3099cba3-1ea7-41e5-833a-0cc08e8ee7d8 tempest-VolumesNegativeTest-380584670 tempest-VolumesNegativeTest-380584670-project] 10.222.0.73 "GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d" status: 404 len: 111 microversion: 2.1 time: 0.077558 Aug 29 20:17:55.755509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 277/541] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:17:55 2022] GET /compute/v2.1/servers/055081ad-325c-49db-addd-916c73e8f97d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:17:55.990865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:55.991564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:56.005878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:56.006795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:56.007622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:56.009773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:56.011110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:56.012232 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:56.526469 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:56.542394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:56.547242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:56.550204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-23e0cefe-9d48-41a3-978c-f7d9ecb22ce4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.564569 Aug 29 20:17:56.562560 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 265/542] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:55 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:57.584779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:57.592142 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:57.607005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:57.608123 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:57.608690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:57.609693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:57.611017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:57.611960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:57.941783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:57.968507 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:57.971770 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:57.975217 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-acaf1176-a887-4e75-9678-c58a648d7956 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.393752 Aug 29 20:17:58.009208 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 278/543] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:57 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:59.021492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:59.022954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:59.032245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:59.033045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:59.034075 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:59.035487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:59.036203 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:59.036794 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:59.403163 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:59.461690 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:59.464597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:59.466764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8944b23a-1cee-476d-81c7-b40dae6f525d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1807 microversion: 2.20 time: 0.452430 Aug 29 20:17:59.467733 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 266/544] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:17:59 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1807 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:00.523902 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:00.525019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:00.568948 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:00.570699 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:00.571670 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:00.573662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:00.578300 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:00.580125 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:00.987783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:00.994176 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=100 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:01.007033 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:01.010075 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:01.012555 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e045c31a-6ad7-4e45-910c-eb81d13e6a3d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1794 microversion: 2.20 time: 0.496173 Aug 29 20:18:01.031638 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 279/545] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:18:00 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1794 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:06.307153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6b57af84-1d36-4235-b6a6-8d2ed873085e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Action: 'create', calling method: .version_select at 0x7f15f9e5c310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-220491953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODN9GaLzGnLZHJ5H8DJsWFJ2I3xf32oPQsfU9N5qPs/CjSBRC/zTZTudsmflJf4rXBDs9zVT185KqgF2fndyW3v8SEU1BhyJ36tMNa8rvyx3xKlD4DV2phu0gqXHmIosw=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:06.326926 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-6b57af84-1d36-4235-b6a6-8d2ed873085e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Getting quotas for project ff3969ffe8ff411b8773e1f3f3cb0b40. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:06.332827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-6b57af84-1d36-4235-b6a6-8d2ed873085e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Getting quotas for user 8640600ca0d745cda547a1027c947089 and project ff3969ffe8ff411b8773e1f3f3cb0b40. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:06.363066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6b57af84-1d36-4235-b6a6-8d2ed873085e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.341099 Aug 29 20:18:06.364063 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 267/546] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:18:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:12.247314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:12.247911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:12.250295 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:18:12.250571 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Mon Aug 29 20:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments/d447c8eb-7f88-49c1-a274-ddc4b38067ce (ip 10.222.0.73) !!! Aug 29 20:18:12.252730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=17 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.258960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:12.259454 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:12.259869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:12.260589 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:12.261037 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:12.261460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:12.422052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lazy-loading 'services' on Instance uuid 06e26ac8-5eaa-4408-8208-b082661ea002 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:12.607211 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b874718d-a943-46d5-aa05-bf48744c92ef tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "DELETE /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments/d447c8eb-7f88-49c1-a274-ddc4b38067ce" status: 202 len: 0 microversion: 2.1 time: 0.365838 Aug 29 20:18:12.608078 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 280/547] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:18:12 2022] DELETE /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments/d447c8eb-7f88-49c1-a274-ddc4b38067ce => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:18:12.617595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=86 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.622638 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:12.624886 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:12.637046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:12.637844 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:12.638639 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:12.639917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:12.640755 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:12.641537 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:12.690895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-27fbccde-7dd1-4578-9b74-9f46bc73053b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075359 Aug 29 20:18:12.691782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 268/548] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:18:12 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:13.706596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:13.709540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:13.716617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.717243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.717749 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.718572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.719076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.719532 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.756104 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3de24248-67db-4cd3-b686-3e0f33c987fc tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056681 Aug 29 20:18:13.756683 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 281/549] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:18:13 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:18:14.769727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:14.771865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:14.778616 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:14.779088 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:14.779512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:14.780202 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:14.780647 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:14.781057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:14.819943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8a0f6119-a603-4e4e-b9c2-e17428e92919 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055019 Aug 29 20:18:14.820739 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 269/550] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:18:14 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:18:14.930959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:14.931634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:14.938081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:14.938568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:14.939149 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:14.940009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:14.940470 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:14.940894 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:14.980291 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:18:15.074944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ee056b9a-fe18-47d9-a200-bc356bd07f2a tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "DELETE /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 204 len: 0 microversion: 2.1 time: 0.146939 Aug 29 20:18:15.075875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 282/551] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:18:14 2022] DELETE /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:15.086997 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:15.088244 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:15.097679 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:15.098454 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:15.099130 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:15.100202 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:15.100878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:15.101513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:15.272840 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:15.281136 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f293aba4-38a1-4825-9f17-5b3a70749b37 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1690 microversion: 2.1 time: 0.199550 Aug 29 20:18:15.281746 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 270/552] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:15 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:16.311719 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:16.312662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:16.320551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:16.321035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:16.321464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:16.322229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:16.322676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:16.323092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:16.517006 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:16.527585 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-279067a3-5d9f-4844-b027-1570559a0eb6 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1690 microversion: 2.1 time: 0.220150 Aug 29 20:18:16.528166 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 283/553] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:16 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:17.552943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:17.553723 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:17.556184 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:17.562251 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:17.562736 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:17.563169 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:17.563879 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:17.564409 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:17.564835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:17.744713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:17.754598 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5ebe7f9c-de99-4ce9-8b57-329753654a90 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1690 microversion: 2.1 time: 0.206496 Aug 29 20:18:17.755192 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 271/554] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:17 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:18.780348 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:18.781434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:18.793171 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.793939 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.794607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.795928 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.796792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.797482 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.977219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:18.991000 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3108a560-4098-43dc-933d-416b4e5a77d9 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1690 microversion: 2.1 time: 0.217467 Aug 29 20:18:18.991672 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 284/555] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:18 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:20.022567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:20.023225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:20.029915 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:20.030401 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:20.030834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:20.031545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:20.032011 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:20.032433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:20.357213 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:20.366913 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b62b0489-da7f-4dcc-bc6c-57ec2fe6b0b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1690 microversion: 2.1 time: 0.348159 Aug 29 20:18:20.367474 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 272/556] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:20 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1690 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:21.342103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-5d7ecb97-a448-4a5d-8264-3f918c44f9c9 req-951c899e-f196-4ae7-a368-fa0be8ffbf45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e26ac8-5eaa-4408-8208-b082661ea002", "name": "network-vif-deleted", "tag": "c2122474-4565-44ec-986a-9646613e2d4e"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:21.359821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-5d7ecb97-a448-4a5d-8264-3f918c44f9c9 req-951c899e-f196-4ae7-a368-fa0be8ffbf45 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:21.360587 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-5d7ecb97-a448-4a5d-8264-3f918c44f9c9 req-951c899e-f196-4ae7-a368-fa0be8ffbf45 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:21.361254 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-5d7ecb97-a448-4a5d-8264-3f918c44f9c9 req-951c899e-f196-4ae7-a368-fa0be8ffbf45 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:21.385008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-5d7ecb97-a448-4a5d-8264-3f918c44f9c9 req-951c899e-f196-4ae7-a368-fa0be8ffbf45 service nova] Creating event network-vif-deleted:c2122474-4565-44ec-986a-9646613e2d4e for instance 06e26ac8-5eaa-4408-8208-b082661ea002 on hv-cinder-85426 Aug 29 20:18:21.390001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:21.391568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:21.395268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-5d7ecb97-a448-4a5d-8264-3f918c44f9c9 req-951c899e-f196-4ae7-a368-fa0be8ffbf45 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159517 Aug 29 20:18:21.397204 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 285/557] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:21.409062 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:21.453412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:21.454589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:21.457150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:21.459465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:21.460275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:21.462782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:21.531127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:21.531746 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:21.532250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:21.532808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lazy-loading 'fault' on Instance uuid 06e26ac8-5eaa-4408-8208-b082661ea002 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:21.592075 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:21.606268 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9f0cf0c9-6d1d-4e95-93dd-041de1b13e80 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 200 len: 1336 microversion: 2.1 time: 0.220238 Aug 29 20:18:21.608555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 273/558] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:21 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 1336 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:22.640118 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:22.640821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 06e26ac8-5eaa-4408-8208-b082661ea002] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:22.649153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:22.649861 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:22.650964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:22.651901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:22.652521 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:22.653079 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:22.671301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] HTTP exception thrown: Instance 06e26ac8-5eaa-4408-8208-b082661ea002 could not be found. Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Request method failure captured: Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 HTTP/1.1 Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR28w0cdbqbjUs7cPGu7Z3OpjfbycPDV81CmrJ2VVTtylWpySvnPIB1VScYNDbHLRzClVx9T9FNVGLsetYZRxK-OeEFHX2UT0dVXCTtnV8PQta4BG_v1Chna25Ls1ii1hIZxIMuA3GvqvqMgjb8d0H4ctp2OnlDzQgoj8Uo1iZRI7O8 Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:18:22.673138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bbb0263903e14938b44d9a6b430d84ce"}]}] Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: e75b537d44524de192282b10825293f9 Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 06e26ac8-5eaa-4408-8208-b082661ea002 could not be found. Aug 29 20:18:22.675479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '06e26ac8-5eaa-4408-8208-b082661ea002'} Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e26ac8-5eaa-4408-8208-b082661ea002 could not be found. Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:18:22.676859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e26ac8-5eaa-4408-8208-b082661ea002 could not be found. Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e26ac8-5eaa-4408-8208-b082661ea002 could not be found. Aug 29 20:18:22.678598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:22.679935 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Returning 404 to user: Instance 06e26ac8-5eaa-4408-8208-b082661ea002 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:18:22.679935 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d62acc6a-851d-45e3-9bcf-a7d9e5cddd94 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002" status: 404 len: 111 microversion: 2.1 time: 0.048125 Aug 29 20:18:22.684370 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 286/559] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:22 2022] GET /compute/v2.1/servers/06e26ac8-5eaa-4408-8208-b082661ea002 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:18:22.692440 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2216a04d-a535-436f-8cac-8d27b611954b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '.version_select at 0x7f15f9de0160>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:22.738613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2216a04d-a535-436f-8cac-8d27b611954b tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310939457" status: 202 len: 0 microversion: 2.1 time: 0.052549 Aug 29 20:18:22.739250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 274/560] 10.222.0.73 () {58 vars in 1221 bytes} [Mon Aug 29 20:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310939457 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:18:25.939979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:25.940519 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:25.947059 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:25.947534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:25.947957 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:25.948655 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:25.949096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:25.949512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:25.981298 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:18:26.078604 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b352f5e1-e9e7-444f-b7d6-c13d833b0932 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 204 len: 0 microversion: 2.1 time: 0.142186 Aug 29 20:18:26.079184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 287/561] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:18:25 2022] DELETE /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:26.091069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:26.091733 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:26.103705 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:26.104222 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:26.104797 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:26.107553 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:26.108243 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:26.108669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:26.276581 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:26.285912 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b58972fa-8594-42c4-a1e5-45d2a6885b01 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1508 microversion: 2.1 time: 0.201281 Aug 29 20:18:26.286488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 275/562] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:26 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:26.960813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-334044608", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-220491953", "security_groups": [{"name": "tempest-secgroup-smoke-1427790051"}], "block_device_mapping_v2": [{"uuid": "91202c6e-d020-4f8f-8973-73bb792c2045", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d909eff5-27cf-4d36-886a-2daf13a96ae0"}]}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:27.106327 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] validate_networks() for [('d909eff5-27cf-4d36-886a-2daf13a96ae0', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:18:27.310018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:27.311033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:27.318240 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:27.318713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:27.319142 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:27.320013 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:27.320777 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:27.321199 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:27.487852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:27.500489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-94c8ffd9-7909-4b01-b3e5-b1fb1dcb7244 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1508 microversion: 2.1 time: 0.196452 Aug 29 20:18:27.501123 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 276/563] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:27 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:27.668930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:18:27.669384 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:18:27.669933 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:18:27.670343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:18:27.670792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:18:27.684170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:27.685025 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:27.685838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:27.686653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:27.687156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:27.687641 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:27.706540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Getting quotas for project ff3969ffe8ff411b8773e1f3f3cb0b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:27.710846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Getting quotas for user 8640600ca0d745cda547a1027c947089 and project ff3969ffe8ff411b8773e1f3f3cb0b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:27.773595 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:18:27.775821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91202c6e-d020-4f8f-8973-73bb792c2045',volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:18:27.944458 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b01f8104-3fb4-498a-a6bb-e24aa2243136 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.987783 Aug 29 20:18:27.945220 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 288/564] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:18:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:18:27.956169 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cf03c95a-09c6-4e9b-b9a5-c8fd4623e2e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:27.956775 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cf03c95a-09c6-4e9b-b9a5-c8fd4623e2e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:28.028360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cf03c95a-09c6-4e9b-b9a5-c8fd4623e2e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:28.037415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cf03c95a-09c6-4e9b-b9a5-c8fd4623e2e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1093 microversion: 2.1 time: 0.085061 Aug 29 20:18:28.038076 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 277/565] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:27 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:28.535916 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:28.537543 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:28.548039 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:28.548705 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:28.549477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:28.550575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:28.551255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:28.551799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:28.718367 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:28.726615 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-559239aa-a11e-40fa-b526-b110db3079ac tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1508 microversion: 2.1 time: 0.196260 Aug 29 20:18:28.727201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 289/566] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:28 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:28.977926 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-115028cd-71a3-4559-9c96-f53b73076ace req-5069daed-6f6e-43a7-9a92-c8e9c3ce913e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e22a8cb-d313-4f23-81e1-304ce615af98", "name": "network-vif-deleted", "tag": "176564cc-c512-416f-a721-31a4c9f05c08"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:28.991494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-115028cd-71a3-4559-9c96-f53b73076ace req-5069daed-6f6e-43a7-9a92-c8e9c3ce913e service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:28.992546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-115028cd-71a3-4559-9c96-f53b73076ace req-5069daed-6f6e-43a7-9a92-c8e9c3ce913e service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:28.993201 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-115028cd-71a3-4559-9c96-f53b73076ace req-5069daed-6f6e-43a7-9a92-c8e9c3ce913e service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:29.010172 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-115028cd-71a3-4559-9c96-f53b73076ace req-5069daed-6f6e-43a7-9a92-c8e9c3ce913e service nova] Creating event network-vif-deleted:176564cc-c512-416f-a721-31a4c9f05c08 for instance 9e22a8cb-d313-4f23-81e1-304ce615af98 on hv-cinder-85426 Aug 29 20:18:29.016797 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-115028cd-71a3-4559-9c96-f53b73076ace req-5069daed-6f6e-43a7-9a92-c8e9c3ce913e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042608 Aug 29 20:18:29.018489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 278/567] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:29.072233 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:29.072861 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:29.084265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:29.085016 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:29.085747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:29.086947 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:29.087704 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:29.088265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:29.160132 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:29.169878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3b8bba4e-d894-4ef8-aec9-1304e37d9d25 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1191 microversion: 2.1 time: 0.104100 Aug 29 20:18:29.177029 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 290/568] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:29 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:29.748796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:29.749830 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:29.757364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:29.757888 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:29.758348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:29.759426 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:29.760110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:29.760531 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:29.814318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:29.816128 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:29.816820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:29.817998 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lazy-loading 'fault' on Instance uuid 9e22a8cb-d313-4f23-81e1-304ce615af98 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:29.941256 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:29.953047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-878cad08-c05d-452b-af25-72d8eec25302 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 200 len: 1311 microversion: 2.1 time: 0.208484 Aug 29 20:18:29.954200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 279/569] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:29 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:30.198364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:30.198994 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:30.206988 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:30.207472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:30.208273 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:30.208977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:30.210026 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:30.210026 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:30.302180 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:30.312904 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-02fa71f6-e293-46bd-9fd4-97f589d6bd22 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1209 microversion: 2.1 time: 0.125382 Aug 29 20:18:30.313688 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 291/570] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:30 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1209 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:30.986224 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:30.988548 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: 9e22a8cb-d313-4f23-81e1-304ce615af98] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:31.003399 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:31.004025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:31.004868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:31.005699 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:31.006300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:31.006737 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:31.023307 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] HTTP exception thrown: Instance 9e22a8cb-d313-4f23-81e1-304ce615af98 could not be found. Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Request method failure captured: Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 HTTP/1.1 Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR28w0cdbqbjUs7cPGu7Z3OpjfbycPDV81CmrJ2VVTtylWpySvnPIB1VScYNDbHLRzClVx9T9FNVGLsetYZRxK-OeEFHX2UT0dVXCTtnV8PQta4BG_v1Chna25Ls1ii1hIZxIMuA3GvqvqMgjb8d0H4ctp2OnlDzQgoj8Uo1iZRI7O8 Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:18:31.025425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bbb0263903e14938b44d9a6b430d84ce"}]}] Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: e75b537d44524de192282b10825293f9 Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 9e22a8cb-d313-4f23-81e1-304ce615af98 could not be found. Aug 29 20:18:31.028190 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '9e22a8cb-d313-4f23-81e1-304ce615af98'} Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e22a8cb-d313-4f23-81e1-304ce615af98 could not be found. Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:18:31.030041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e22a8cb-d313-4f23-81e1-304ce615af98 could not be found. Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e22a8cb-d313-4f23-81e1-304ce615af98 could not be found. Aug 29 20:18:31.032534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:31.038294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Returning 404 to user: Instance 9e22a8cb-d313-4f23-81e1-304ce615af98 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:18:31.038294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-02467aa8-d01c-4cd9-9f09-c5f6d29b76d7 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98" status: 404 len: 111 microversion: 2.1 time: 0.047817 Aug 29 20:18:31.038294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 280/571] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:30 2022] GET /compute/v2.1/servers/9e22a8cb-d313-4f23-81e1-304ce615af98 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:18:31.045498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:31.046102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:31.067192 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:31.069450 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:31.070501 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:31.071427 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:31.072045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:31.072730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:31.116004 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:18:31.182897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:31.238911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7271233c-8d90-4254-bd7f-a7c075cd70b1 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 204 len: 0 microversion: 2.1 time: 0.202443 Aug 29 20:18:31.243146 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 292/572] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:18:31 2022] DELETE /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:31.254372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:31.255989 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:31.265585 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:31.266592 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:31.268032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:31.269310 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:31.270178 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:31.270767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:31.341269 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:31.342240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:31.349601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:31.350115 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:31.350541 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:31.351278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:31.351718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:31.352303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:31.515355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:31.527271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2b941038-a80a-4e5c-a46c-27b18b6835e8 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.281715 Aug 29 20:18:31.528901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 281/573] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:31 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:31.597511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:31.610736 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cf4345ad-6c34-4c18-9338-67616da7bc7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1277 microversion: 2.1 time: 0.273679 Aug 29 20:18:31.612409 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 293/574] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:31 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1277 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:32.044488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-3bf64fa6-d282-414e-96e4-003e966b3ffa req-09e5ec2d-d86d-492b-8ac2-6dc6db88332b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9785564a-cd3d-4595-8af9-dbb8f45a4920", "tag": "a5f16ea7-0d10-4de8-b264-64fb2d5c7d6f"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:32.057767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3bf64fa6-d282-414e-96e4-003e966b3ffa req-09e5ec2d-d86d-492b-8ac2-6dc6db88332b service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:32.058261 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3bf64fa6-d282-414e-96e4-003e966b3ffa req-09e5ec2d-d86d-492b-8ac2-6dc6db88332b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:32.058730 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3bf64fa6-d282-414e-96e4-003e966b3ffa req-09e5ec2d-d86d-492b-8ac2-6dc6db88332b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:32.072963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-3bf64fa6-d282-414e-96e4-003e966b3ffa req-09e5ec2d-d86d-492b-8ac2-6dc6db88332b service nova] Creating event network-changed:a5f16ea7-0d10-4de8-b264-64fb2d5c7d6f for instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 on hv-cinder-85426 Aug 29 20:18:32.078703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-3bf64fa6-d282-414e-96e4-003e966b3ffa req-09e5ec2d-d86d-492b-8ac2-6dc6db88332b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037297 Aug 29 20:18:32.079370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 282/575] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:32.551650 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:32.552342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:32.559490 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:32.559879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:32.560433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:32.561139 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:32.561587 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:32.562048 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:32.634909 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:32.635710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:32.649243 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:32.650021 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:32.650520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:32.651624 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:32.652819 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:32.653234 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:32.718470 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:32.733532 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6fa53378-0774-472a-a0c4-88f3ae368531 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.185559 Aug 29 20:18:32.734643 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 294/576] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:32 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:32.834776 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:32.843042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-19ee3d5e-1657-41f4-b75a-b3d6bd33a5d9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1277 microversion: 2.1 time: 0.212575 Aug 29 20:18:32.843657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 283/577] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:32 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:33.757163 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:33.757810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:33.764509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:33.765019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:33.765441 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:33.766159 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:33.766609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:33.767014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:33.865498 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:33.866191 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:33.875043 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:33.875239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:33.875557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:33.877346 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:33.878464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:33.879014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:33.944314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:33.953308 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-90a916ee-1436-4c53-890e-e94c27f76580 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.200059 Aug 29 20:18:33.954133 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 295/578] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:33 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:34.075390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:34.084617 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-65f56086-583c-40ee-a237-d5d4ddede239 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1277 microversion: 2.1 time: 0.223155 Aug 29 20:18:34.085331 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 284/579] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:33 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:34.987680 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:34.988866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:35.001492 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:35.002291 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:35.003473 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:35.004889 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:35.005515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:35.007875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:35.116207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:35.116844 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:35.123877 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:35.124361 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:35.124787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:35.125486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:35.125990 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:35.126419 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:35.456978 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:35.473499 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-46aaaf6f-04b6-46ae-ade7-ff3c660936d6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.362432 Aug 29 20:18:35.474864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 285/580] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:35 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:35.509751 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:35.522315 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6308b8c8-7a9f-4592-a7e4-1a5fff669926 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1523 microversion: 2.1 time: 0.548507 Aug 29 20:18:35.523419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 296/581] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:34 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1523 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:35.754723 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-12dbc849-234e-4eb1-a63b-b12976e27807 req-fa0f3943-1864-4938-860b-bc11a5e8895a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4067659-cb5f-422b-a547-f871635abe7a", "name": "network-vif-deleted", "tag": "5a9c4a5b-6d99-489b-b1bc-edf1c4b8c63c"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:35.770533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-12dbc849-234e-4eb1-a63b-b12976e27807 req-fa0f3943-1864-4938-860b-bc11a5e8895a service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:35.771183 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-12dbc849-234e-4eb1-a63b-b12976e27807 req-fa0f3943-1864-4938-860b-bc11a5e8895a service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:35.771730 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-12dbc849-234e-4eb1-a63b-b12976e27807 req-fa0f3943-1864-4938-860b-bc11a5e8895a service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:35.788983 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-12dbc849-234e-4eb1-a63b-b12976e27807 req-fa0f3943-1864-4938-860b-bc11a5e8895a service nova] Creating event network-vif-deleted:5a9c4a5b-6d99-489b-b1bc-edf1c4b8c63c for instance e4067659-cb5f-422b-a547-f871635abe7a on hv-cinder-85426 Aug 29 20:18:35.796743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-12dbc849-234e-4eb1-a63b-b12976e27807 req-fa0f3943-1864-4938-860b-bc11a5e8895a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144054 Aug 29 20:18:35.797537 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 286/582] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:36.501505 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:36.503131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:36.511603 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:36.512085 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:36.512511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:36.513229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:36.513784 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:36.514205 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:36.551886 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:36.552585 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:36.559304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:36.559800 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:36.562265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:36.563049 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:36.563488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:36.563910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:36.624217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:36.625243 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:36.625984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:36.626600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lazy-loading 'fault' on Instance uuid e4067659-cb5f-422b-a547-f871635abe7a {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:36.688492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75b537d44524de192282b10825293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb0263903e14938b44d9a6b430d84ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:36.702751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-40508611-cfad-4314-9cbd-afca4ac162d2 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 200 len: 1312 microversion: 2.1 time: 0.156818 Aug 29 20:18:36.703906 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 287/583] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:36 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:36.764334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:36.776529 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-01ef2481-77a1-4747-94ba-9fd0af897043 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.280723 Aug 29 20:18:36.777115 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 297/584] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:36 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:37.753151 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:37.754121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] [instance: e4067659-cb5f-422b-a547-f871635abe7a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:37.763967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:37.764931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:37.765642 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:37.766757 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:37.767457 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:37.768114 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:37.775003 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:37.788380 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] HTTP exception thrown: Instance e4067659-cb5f-422b-a547-f871635abe7a could not be found. Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Request method failure captured: Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a HTTP/1.1 Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR28w0cdbqbjUs7cPGu7Z3OpjfbycPDV81CmrJ2VVTtylWpySvnPIB1VScYNDbHLRzClVx9T9FNVGLsetYZRxK-OeEFHX2UT0dVXCTtnV8PQta4BG_v1Chna25Ls1ii1hIZxIMuA3GvqvqMgjb8d0H4ctp2OnlDzQgoj8Uo1iZRI7O8 Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:18:37.790294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bbb0263903e14938b44d9a6b430d84ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bbb0263903e14938b44d9a6b430d84ce"}]}] Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: bbb0263903e14938b44d9a6b430d84ce Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2112894432 Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: e75b537d44524de192282b10825293f9 Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2112894432-project Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance e4067659-cb5f-422b-a547-f871635abe7a could not be found. Aug 29 20:18:37.792441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'e4067659-cb5f-422b-a547-f871635abe7a'} Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4067659-cb5f-422b-a547-f871635abe7a could not be found. Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:18:37.793944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4067659-cb5f-422b-a547-f871635abe7a could not be found. Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4067659-cb5f-422b-a547-f871635abe7a could not be found. Aug 29 20:18:37.796265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:18:37.798403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] Returning 404 to user: Instance e4067659-cb5f-422b-a547-f871635abe7a could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:18:37.798403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f54e1ba1-cc43-405d-8349-ac393350e237 tempest-ServerRescueNegativeTestJSON-2112894432 tempest-ServerRescueNegativeTestJSON-2112894432-project] 10.222.0.73 "GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a" status: 404 len: 111 microversion: 2.1 time: 0.045267 Aug 29 20:18:37.798403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 288/585] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:37 2022] GET /compute/v2.1/servers/e4067659-cb5f-422b-a547-f871635abe7a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:18:37.809070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:37.810444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:37.817385 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:37.818457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=6 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:37.825649 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:37.826464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:37.827200 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:37.828346 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:37.829076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:37.829815 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:38.120850 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:38.133683 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-13d6fe0c-2ca9-4694-b332-f8cd3adafd04 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.330656 Aug 29 20:18:38.134737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 298/586] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:37 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:39.168041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:39.169303 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:39.171426 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:39.178236 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:39.178733 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:39.179189 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:39.179969 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:39.180351 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:39.180721 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:39.364929 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:39.373326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-befc8109-6fa0-4738-a9ff-d83ac553f69b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.209085 Aug 29 20:18:39.373949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 289/587] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:39 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:40.397188 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:40.397872 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:40.404920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:40.405411 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:40.405940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:40.406594 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:40.407050 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:40.407472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:40.616758 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:40.626286 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-914da520-ec71-4c00-afb2-4707eb1ed4cd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.233221 Aug 29 20:18:40.626899 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 299/588] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:40 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:41.650142 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:41.651464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:41.658419 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:41.659047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:41.659666 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:41.660784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:41.661584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:41.662931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:41.924761 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:41.950210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7cb175b4-94e2-4e80-82ef-1b8cf9846d99 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.304819 Aug 29 20:18:41.952156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 290/589] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:41 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:42.972165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:42.972802 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:42.975194 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:42.981211 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:42.981734 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:42.982182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:42.983171 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:42.983614 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:42.984036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:43.149162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:43.161941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-86e1e5bc-b6ee-4ff4-bbe3-bcd228df5a2a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.193352 Aug 29 20:18:43.162516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 300/590] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:42 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:44.187656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:44.189290 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:44.199767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:44.200781 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:44.201465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:44.202843 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:44.203891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:44.204706 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:44.482843 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:44.494351 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5146e11c-15b5-4eef-9395-4d5acf273d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.311434 Aug 29 20:18:44.495142 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 291/591] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:44 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:45.516592 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:45.517940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:45.526805 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:45.529640 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:45.530261 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:45.531095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:45.531638 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:45.532251 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:45.725934 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:45.735806 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5dc61c93-ec05-4907-82e7-fad606358d3b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.223131 Aug 29 20:18:45.737942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 301/592] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:45 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:46.280578 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:46.287715 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:46.299466 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:46.300868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:46.301527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:46.302353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:46.303429 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:46.304051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:46.349538 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c960e02f-acd4-499e-83ca-25cd975af9b5 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072761 Aug 29 20:18:46.350625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 292/593] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:18:46 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:18:46.429127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:46.429127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:46.438483 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:46.439284 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:46.440421 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:46.441227 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:46.441796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:46.442286 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:46.471619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:18:46.599135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-fd15b9de-b732-41b5-a8c0-500153f3ffa3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 204 len: 0 microversion: 2.1 time: 0.177067 Aug 29 20:18:46.599938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 302/594] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:18:46 2022] DELETE /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:46.608875 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:46.608875 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:46.615359 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:46.616132 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:46.616749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:46.617869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:46.618516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:46.619342 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:46.761423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:46.762173 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:46.773691 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:46.774791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:46.775973 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:46.777495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:46.778856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:46.780143 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:46.781307 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:46.791412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7ff6cc7b-1830-42a7-84c5-91825b4c4406 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1671 microversion: 2.1 time: 0.187269 Aug 29 20:18:46.792314 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 293/595] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:46 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:47.085241 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:47.103899 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1312fec6-b645-4126-a779-b0ba23af1ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.346909 Aug 29 20:18:47.104483 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 303/596] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:46 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:47.565325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-57e87caa-eb88-4b4e-918c-96572008be10 req-b336e594-bdc9-4313-8bee-0ada528ca199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9785564a-cd3d-4595-8af9-dbb8f45a4920", "name": "network-vif-plugged", "status": "completed", "tag": "a5f16ea7-0d10-4de8-b264-64fb2d5c7d6f"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:47.578276 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-57e87caa-eb88-4b4e-918c-96572008be10 req-b336e594-bdc9-4313-8bee-0ada528ca199 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:47.580949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-57e87caa-eb88-4b4e-918c-96572008be10 req-b336e594-bdc9-4313-8bee-0ada528ca199 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:47.581510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-57e87caa-eb88-4b4e-918c-96572008be10 req-b336e594-bdc9-4313-8bee-0ada528ca199 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:47.597552 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-57e87caa-eb88-4b4e-918c-96572008be10 req-b336e594-bdc9-4313-8bee-0ada528ca199 service nova] Creating event network-vif-plugged:a5f16ea7-0d10-4de8-b264-64fb2d5c7d6f for instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 on hv-cinder-85426 Aug 29 20:18:47.605414 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-57e87caa-eb88-4b4e-918c-96572008be10 req-b336e594-bdc9-4313-8bee-0ada528ca199 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317757 Aug 29 20:18:47.607082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 294/597] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:47.829645 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:47.830472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:47.846627 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:47.848650 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:47.849587 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:47.850472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:47.851036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:47.851537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:48.129993 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:48.131121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:48.138371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:48.139209 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:48.139714 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:48.140498 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:48.141035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:48.141531 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:48.194080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:48.237538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7a733ee5-4961-4c9f-8086-34b63308ebc1 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1671 microversion: 2.1 time: 0.415539 Aug 29 20:18:48.239452 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 304/598] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:47 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1671 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:48.415143 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:48.433858 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ff6b14c6-253a-45f3-abe9-c640fa3421f1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.310541 Aug 29 20:18:48.434438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 295/599] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:48 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:48.865458 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-21b2b0f2-7ffb-44b1-81f4-9815b24b7dc1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: .version_select at 0x7f15f9df0280>, body: {"keypair": {"name": "tempest-keypair-647033378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+SIhCUkftLf0zmCIxQ0dIWGYeb0D5TT4YEvesBjctu81K6YaC2G8hkr7w7iP0bDn6s3XZjKGc7X3lCJ553wDt4yyOkRo5iWsrDYIYmXerKnRIxsUSw0oy4NBCZySZ0lQ=="}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:48.883104 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-21b2b0f2-7ffb-44b1-81f4-9815b24b7dc1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:48.888272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-21b2b0f2-7ffb-44b1-81f4-9815b24b7dc1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for user c7c8422c3d314adca25acf967ffd0998 and project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:48.934745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-21b2b0f2-7ffb-44b1-81f4-9815b24b7dc1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146509 Aug 29 20:18:48.938075 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 305/600] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:18:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:49.266983 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:49.268615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:49.275223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:49.276186 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:49.276982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:49.278444 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:49.279225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:49.279882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:49.468576 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:49.469180 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:49.484956 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:49.485453 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:49.485934 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:49.497596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:49.503335 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:49.504166 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:49.571712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:49.604500 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-be447e2b-f637-4e97-aeb8-e551576617cc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1604 microversion: 2.1 time: 0.344743 Aug 29 20:18:49.617753 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 296/601] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:49 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1604 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:49.617753 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-694f732e-2362-43b0-bd22-52416eec99f0 req-9839a7a4-b13a-4286-ba1a-693a481588db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "856657fa-097f-45c6-baeb-cc6a9d494a26", "name": "network-vif-deleted", "tag": "2abb764e-7b21-4846-a0ae-4823b1e93dde"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:49.684375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-694f732e-2362-43b0-bd22-52416eec99f0 req-9839a7a4-b13a-4286-ba1a-693a481588db service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:49.684867 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-694f732e-2362-43b0-bd22-52416eec99f0 req-9839a7a4-b13a-4286-ba1a-693a481588db service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:49.685294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-694f732e-2362-43b0-bd22-52416eec99f0 req-9839a7a4-b13a-4286-ba1a-693a481588db service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:49.724832 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-694f732e-2362-43b0-bd22-52416eec99f0 req-9839a7a4-b13a-4286-ba1a-693a481588db service nova] Creating event network-vif-deleted:2abb764e-7b21-4846-a0ae-4823b1e93dde for instance 856657fa-097f-45c6-baeb-cc6a9d494a26 on hv-cinder-85426 Aug 29 20:18:49.732729 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-694f732e-2362-43b0-bd22-52416eec99f0 req-9839a7a4-b13a-4286-ba1a-693a481588db service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123780 Aug 29 20:18:49.733630 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 297/602] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:49.869266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:49.884723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cb2cfee8-e979-4e0c-a2b8-129b1737f970 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1265 microversion: 2.1 time: 0.421920 Aug 29 20:18:49.886265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 306/603] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:49 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:50.649397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:50.652376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:50.670246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:50.671193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:50.671934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:50.673275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:50.674693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:50.675441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:50.734401 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:50.734894 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:50.735366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:50.735821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lazy-loading 'fault' on Instance uuid 856657fa-097f-45c6-baeb-cc6a9d494a26 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:50.806991 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:50.816243 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-de5b920a-dd93-4437-8d41-5fc2d1905254 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 200 len: 1327 microversion: 2.1 time: 0.184813 Aug 29 20:18:50.816927 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 298/604] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:50 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 1327 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:50.909439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:50.910873 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:50.919748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:50.920514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:50.921362 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:50.922440 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:50.923128 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:50.925310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:51.022471 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1919713432", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68f99afd-3890-4bbb-ac8f-4e5af64abbb6"}], "security_groups": [{"name": "tempest-securitygroup--1265861705"}], "key_name": "tempest-keypair-647033378", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:51.117692 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:51.126533 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cd166711-cf8b-4137-af80-7d30230ab87d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1452 microversion: 2.1 time: 0.221429 Aug 29 20:18:51.127965 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 307/605] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:50 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1452 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:51.148260 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:51.149291 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:51.155639 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:51.156126 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:51.156758 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:51.157474 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:51.157964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:51.158763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:51.173118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] validate_networks() for [('68f99afd-3890-4bbb-ac8f-4e5af64abbb6', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:18:51.359315 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:51.365884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:51.383033 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1602bdf9-5956-4bce-b129-3f07d8dee574 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1452 microversion: 2.1 time: 0.238178 Aug 29 20:18:51.384389 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 308/606] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:51 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:51.542837 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:51.842383 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:51.843546 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:51.851925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:51.852807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:51.853462 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:51.854247 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:51.854892 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:51.855709 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:51.876646 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] HTTP exception thrown: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Request method failure captured: Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 HTTP/1.1 Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR26ISzuDRmUxl5QZXR5ZzoR6ow0fkaUFAU4z1tMsEdgemR84k7gCtg_ZSGi9fvXSH8OHcvikiexMUpO8DZzythGahXzPAY2nD9iDGkudji1UojLbgXzpaBCwGyU9xORRem-kK2-UhUbdcMDhfX4my3bn3qEvWj8lEFkR2k4r7odObM Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:18:51.878782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6fb06a5fd3a3482d991c542ccc993e88"}]}] Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 04c2aae2da284df29243b99d33725ddd Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:18:51.880864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '856657fa-097f-45c6-baeb-cc6a9d494a26'} Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:18:51.881903 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:18:51.883573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:18:51.885286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:18:51.885777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Returning 404 to user: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:18:51.885932 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:18:51.885932 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:18:51.885932 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:18:51.885932 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:18:51.886464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e489fe76-29b7-438f-84de-0c38f898fb44 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 404 len: 111 microversion: 2.1 time: 0.044992 Aug 29 20:18:51.889497 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 309/607] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:51 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:18:51.895550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-97e59a73-a3e2-4bdd-ad1a-96cee671ed45 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '.version_select at 0x7f15f9d3cb80>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:51.911645 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:51.912773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:51.913533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:51.914716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:51.915937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:51.916534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:51.928157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-97e59a73-a3e2-4bdd-ad1a-96cee671ed45 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845302019" status: 202 len: 0 microversion: 2.1 time: 0.037173 Aug 29 20:18:51.930137 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 310/608] 10.222.0.73 () {58 vars in 1218 bytes} [Mon Aug 29 20:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845302019 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:18:51.943222 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:51.948329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for user c7c8422c3d314adca25acf967ffd0998 and project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:51.961587 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:18:51.964183 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:18:52.006173 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:52.007022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:52.016961 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.017340 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.018149 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.019491 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.020522 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.021512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.046300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f99b1de0-8b02-4bc4-9274-f4579c116e22 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.029069 Aug 29 20:18:52.055769 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 299/609] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:18:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:18:52.063364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4d4838e2-2014-4f28-bef2-b08c42557733 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments/4d1a1886-05c3-4d3e-95db-ceac7225ce7c" status: 200 len: 194 microversion: 2.20 time: 0.062650 Aug 29 20:18:52.064584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 311/610] 10.222.0.73 () {60 vars in 1454 bytes} [Mon Aug 29 20:18:51 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments/4d1a1886-05c3-4d3e-95db-ceac7225ce7c => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:52.082401 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-178b3431-e9bd-4c90-8722-147886e64aaa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:52.083081 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-178b3431-e9bd-4c90-8722-147886e64aaa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:52.151744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:52.152497 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:52.160382 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.161086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.161776 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.162644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.163526 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.164097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.272053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lazy-loading 'services' on Instance uuid b86403f3-4482-4e27-9f97-cdf8fc2dd9ad {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:52.403476 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b33c085f-084a-49c3-828d-7538db51bd7c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments/4d1a1886-05c3-4d3e-95db-ceac7225ce7c" status: 202 len: 0 microversion: 2.20 time: 0.255414 Aug 29 20:18:52.410874 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 312/611] 10.222.0.73 () {60 vars in 1457 bytes} [Mon Aug 29 20:18:52 2022] DELETE /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments/4d1a1886-05c3-4d3e-95db-ceac7225ce7c => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:18:52.421188 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:52.425960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:52.437446 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.439869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.441203 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.442969 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.443753 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.444418 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.496170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e5d1eec8-1d11-43d6-bb87-edfac62cf74e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081831 Aug 29 20:18:52.497238 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 313/612] 10.222.0.73 () {60 vars in 1343 bytes} [Mon Aug 29 20:18:52 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:52.502358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-178b3431-e9bd-4c90-8722-147886e64aaa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:52.530864 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-178b3431-e9bd-4c90-8722-147886e64aaa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1241 microversion: 2.1 time: 0.455807 Aug 29 20:18:52.532257 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 300/613] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:52 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1241 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:53.512157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:53.515129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:53.524076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:53.525021 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:53.525919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:53.526927 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:53.527610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:53.528268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:53.563160 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:53.564584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:53.586086 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:53.586352 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:53.586837 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:53.588018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:53.588891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:53.589915 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:53.599191 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4c64ec1a-5c34-42a8-be75-e72f28e7f48d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092316 Aug 29 20:18:53.601372 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 314/614] 10.222.0.73 () {60 vars in 1343 bytes} [Mon Aug 29 20:18:53 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:53.727959 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:53.738626 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3a68091e-6b8f-4c18-b418-3b42033ed24f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1293 microversion: 2.1 time: 0.180106 Aug 29 20:18:53.739764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 301/615] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:53 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1293 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:53.792364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-626f4a0d-5937-404e-b07b-5805d5d8d9a6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'create', calling method: .version_select at 0x7f15f9e89af0>, body: {"keypair": {"name": "tempest-keypair-1764102717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7g5/UyGDm+9NKQBMHzE2cR3tXgGlqcDKPGToQTFfLWg1kPFos8pfB0Ljld3bQQ6djPI8s0QVvqgZfBDmtlUYlL99Fokuna2Mrc18gnvJq+eeinCSDCGn43wi/wLJst8A=="}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:53.811119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-626f4a0d-5937-404e-b07b-5805d5d8d9a6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Getting quotas for project 6fb06a5fd3a3482d991c542ccc993e88. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:53.815985 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-626f4a0d-5937-404e-b07b-5805d5d8d9a6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Getting quotas for user 04c2aae2da284df29243b99d33725ddd and project 6fb06a5fd3a3482d991c542ccc993e88. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:53.852857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-626f4a0d-5937-404e-b07b-5805d5d8d9a6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065823 Aug 29 20:18:53.854398 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 315/616] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:18:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:54.613952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:54.617185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:54.627055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.628516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.629097 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.629937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.630688 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.631025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.668876 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-47435d9a-2e3e-45f4-8a07-3d34d1df2c60 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059052 Aug 29 20:18:54.669961 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 302/617] 10.222.0.73 () {60 vars in 1343 bytes} [Mon Aug 29 20:18:54 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:54.738921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:54.739462 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:54.747353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.747848 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.748778 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.749555 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.750093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.751819 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.763576 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:54.764344 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:54.771615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.772877 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.773575 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.774717 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.775406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.776035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.815557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:18:54.899221 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:54.914941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5bb0f465-3a7a-4f97-80cb-ca85712e7e2d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1299 microversion: 2.1 time: 0.156880 Aug 29 20:18:54.916355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 303/618] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:54 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:54.928612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-51685da8-b046-4dc9-a85d-6f3d22cab1a5 req-fdbbef0b-239c-4ca5-b98c-fc7f9906159c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9785564a-cd3d-4595-8af9-dbb8f45a4920", "tag": "a5f16ea7-0d10-4de8-b264-64fb2d5c7d6f"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:54.930215 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3c663ce2-6119-4888-b316-ae1ede9056a6 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 204 len: 0 microversion: 2.20 time: 0.195618 Aug 29 20:18:54.934310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 316/619] 10.222.0.73 () {60 vars in 1280 bytes} [Mon Aug 29 20:18:54 2022] DELETE /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:18:54.940540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:54.941248 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:54.947485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.948255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.948848 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.949963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.950203 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.950811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.951631 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-51685da8-b046-4dc9-a85d-6f3d22cab1a5 req-fdbbef0b-239c-4ca5-b98c-fc7f9906159c service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.952350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-51685da8-b046-4dc9-a85d-6f3d22cab1a5 req-fdbbef0b-239c-4ca5-b98c-fc7f9906159c service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.953332 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-51685da8-b046-4dc9-a85d-6f3d22cab1a5 req-fdbbef0b-239c-4ca5-b98c-fc7f9906159c service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.973958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-51685da8-b046-4dc9-a85d-6f3d22cab1a5 req-fdbbef0b-239c-4ca5-b98c-fc7f9906159c service nova] Creating event network-changed:a5f16ea7-0d10-4de8-b264-64fb2d5c7d6f for instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 on hv-cinder-85426 Aug 29 20:18:54.981028 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-51685da8-b046-4dc9-a85d-6f3d22cab1a5 req-fdbbef0b-239c-4ca5-b98c-fc7f9906159c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062730 Aug 29 20:18:54.981636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 304/620] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:55.137357 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:55.149253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:55.151018 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:55.152428 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6d984c4a-1b8f-4b45-b4c0-12d97f947255 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.216884 Aug 29 20:18:55.153182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 317/621] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:18:54 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:55.942956 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:55.944271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:55.950979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:55.951465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:55.951897 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:55.952612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:55.953088 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:55.953486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.180120 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:56.180842 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:56.189087 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.189567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.190794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.191512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.192343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.192772 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.213164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:56.223035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a6ad22e4-8d6a-4c9e-a9f4-e7aec59e9cbd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.284700 Aug 29 20:18:56.225099 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 305/622] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:55 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:56.370695 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:56.381916 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:56.383345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:56.384901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b0684e29-ea42-4402-884f-eeead05c037b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.211938 Aug 29 20:18:56.385459 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 318/623] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:18:56 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:18:56.501688 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2091439404", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03a78358-12e5-4261-9033-2937f1d7bd0b"}], "security_groups": [{"name": "tempest-securitygroup--393837334"}], "key_name": "tempest-keypair-1764102717", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:56.616895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] validate_networks() for [('03a78358-12e5-4261-9033-2937f1d7bd0b', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:18:57.248244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:57.248843 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:57.256495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.257385 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.258003 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.258861 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.259382 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.259972 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.413274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:18:57.414848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:18:57.415555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:18:57.416044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:18:57.416453 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:18:57.426904 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.427660 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.428088 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.428804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.429525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.429972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.450719 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Getting quotas for project 6fb06a5fd3a3482d991c542ccc993e88. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:57.456545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Getting quotas for user 04c2aae2da284df29243b99d33725ddd and project 6fb06a5fd3a3482d991c542ccc993e88. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:57.470882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:18:57.474391 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:18:57.507728 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:57.531568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5ec293ad-7670-4e71-88a4-fafe80a76f7c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.285231 Aug 29 20:18:57.550513 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 319/624] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:57 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:57.550789 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a5285b5c-7a5c-4531-86ff-260162e491b3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.048889 Aug 29 20:18:57.550789 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 306/625] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:18:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:18:57.551093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:57.553238 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:57.570693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-73ef60fc-c478-408f-a136-7431ed621a14 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:57.571933 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-73ef60fc-c478-408f-a136-7431ed621a14 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:57.577967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.579081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.579728 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.583336 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.585003 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.585666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.664673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-73ef60fc-c478-408f-a136-7431ed621a14 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:57.677427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-73ef60fc-c478-408f-a136-7431ed621a14 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1238 microversion: 2.1 time: 0.110710 Aug 29 20:18:57.678484 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 307/626] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:57 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:57.799442 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:57.814255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:57.816468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:57.818073 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2f8b9b22-6507-411c-9492-d37af7af648a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1722 microversion: 2.20 time: 0.274290 Aug 29 20:18:57.818588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 320/627] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:18:57 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:58.317792 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-82544a9e-cf4f-4dd9-bb90-f6ef23805414 req-d3b91e8f-6221-4242-87f0-59101edaf015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa729ec-2c90-4d71-ab0a-23d73b1dd267", "tag": "211f234f-335d-4a0f-b293-03495489357e"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:58.342379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-82544a9e-cf4f-4dd9-bb90-f6ef23805414 req-d3b91e8f-6221-4242-87f0-59101edaf015 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.343167 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-82544a9e-cf4f-4dd9-bb90-f6ef23805414 req-d3b91e8f-6221-4242-87f0-59101edaf015 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.344007 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-82544a9e-cf4f-4dd9-bb90-f6ef23805414 req-d3b91e8f-6221-4242-87f0-59101edaf015 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.357675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-82544a9e-cf4f-4dd9-bb90-f6ef23805414 req-d3b91e8f-6221-4242-87f0-59101edaf015 service nova] Creating event network-changed:211f234f-335d-4a0f-b293-03495489357e for instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 on hv-cinder-85426 Aug 29 20:18:58.367734 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-82544a9e-cf4f-4dd9-bb90-f6ef23805414 req-d3b91e8f-6221-4242-87f0-59101edaf015 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056786 Aug 29 20:18:58.369372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 308/628] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:58.572466 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:58.573387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:58.588452 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.589343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.590160 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.591794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.592804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.593575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.699032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:58.700333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:58.708973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.709618 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.710179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.711012 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.711707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.712397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.753230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:58.762493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3b68fa1e-8c10-4f40-aa14-dc10b3c42cdb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.195343 Aug 29 20:18:58.763081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 321/629] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:58 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:58.791187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:58.800214 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8f1d8ac5-5a0a-4b0b-a852-a66f26ef00fb tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1290 microversion: 2.1 time: 0.104660 Aug 29 20:18:58.800802 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 309/630] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:58 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1290 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:58.843537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:58.844365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:58.851682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.852174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.852613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.853318 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.853801 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.854273 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.927137 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:58.942559 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:58.945488 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:58.947490 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f0568618-cab5-4882-9251-fd4f39b22253 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1655 microversion: 2.20 time: 0.108439 Aug 29 20:18:58.948515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 322/631] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:18:58 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:59.788480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:59.789383 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:59.796367 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:59.796771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:59.797211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:59.797954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:59.798408 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:59.798831 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:59.821069 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:59.821572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:59.828245 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:59.828729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:59.829190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:59.831461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:59.831461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:59.831461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:59.909323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:59.924584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b1c2e0a7-0cf2-4d1c-b55a-db88dba526a2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1296 microversion: 2.1 time: 0.107566 Aug 29 20:18:59.925363 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 323/632] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:59 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:59.960842 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:59.969418 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ed2d2c36-f642-4df0-845f-45bdc65e1756 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.188598 Aug 29 20:18:59.970053 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 310/633] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:18:59 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:59.973876 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:59.974626 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:59.980973 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:59.981603 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:59.982161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:59.982963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:59.983631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:59.984054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:00.028524 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:00.029064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:00.029491 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:00.029988 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lazy-loading 'fault' on Instance uuid b86403f3-4482-4e27-9f97-cdf8fc2dd9ad {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:00.095375 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:00.109440 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:00.112376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:00.114830 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-49971b8c-e79e-48de-9085-c6da7e74a17a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 200 len: 1371 microversion: 2.20 time: 0.145923 Aug 29 20:19:00.115829 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 324/634] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:18:59 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:00.385791 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-6e0cc77b-678e-4c66-a4ec-b913ab33450d req-134ff78f-f41c-4e67-8989-4d167b44adf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86403f3-4482-4e27-9f97-cdf8fc2dd9ad", "name": "network-vif-deleted", "tag": "4c3e0080-8d58-44c1-8b13-e2b6f6549e47"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:00.395901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6e0cc77b-678e-4c66-a4ec-b913ab33450d req-134ff78f-f41c-4e67-8989-4d167b44adf5 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:00.396368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6e0cc77b-678e-4c66-a4ec-b913ab33450d req-134ff78f-f41c-4e67-8989-4d167b44adf5 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:00.396786 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6e0cc77b-678e-4c66-a4ec-b913ab33450d req-134ff78f-f41c-4e67-8989-4d167b44adf5 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:00.402315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:00.417914 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-6e0cc77b-678e-4c66-a4ec-b913ab33450d req-134ff78f-f41c-4e67-8989-4d167b44adf5 service nova] Creating event network-vif-deleted:4c3e0080-8d58-44c1-8b13-e2b6f6549e47 for instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad on hv-cinder-85426 Aug 29 20:19:00.426918 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-6e0cc77b-678e-4c66-a4ec-b913ab33450d req-134ff78f-f41c-4e67-8989-4d167b44adf5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044456 Aug 29 20:19:00.428102 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 311/635] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:00.951233 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:00.952526 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:00.965950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:00.967390 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:00.968793 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:00.970747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:00.972386 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:00.973486 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:00.993516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:00.994410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:01.007083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.007634 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.008071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.008764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.009211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.009629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.032300 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:01.297651 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:01.305648 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4b1470ff-bc8e-4c08-902f-7c16f052b0af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.317212 Aug 29 20:19:01.306534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 312/636] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:00 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:01.312229 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:01.313018 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:01.315374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:01.320173 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.321144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.321770 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.323739 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.324624 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.325368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.340209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7fe6a906-5c44-42ef-af3e-8c782ee66b18 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1363 microversion: 2.1 time: 0.394523 Aug 29 20:19:01.340792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 325/637] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:00 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:01.352176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] HTTP exception thrown: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Request method failure captured: Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad HTTP/1.1 Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR4pPQ1lFxlfk53v_ttIYVjYasNPSK0IOJ1okVSF-zBXzPNLfiP_5py6-1aZ0--zxUkmKRtITU3EOE7aM4-V89rvtKtdPaI9-bq9_7unnwLLev_-vXgzzC2WEYNcwNlx38MT_c1RXOR5JM5qpSGDk36XzzR5APCSL7oK-85oGwd9Wu8 Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:19:01.354262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fc733dcfcf9043feb354598fc2792ff5"}]}] Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 1ffc617c50984f83adc3269b118c8a91 Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:19:01.356804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'b86403f3-4482-4e27-9f97-cdf8fc2dd9ad'} Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:19:01.358146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:19:01.360265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:19:01.363395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Returning 404 to user: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:19:01.365009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5f1b8e9e-54c0-4341-aea3-49ed71159ae9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 404 len: 111 microversion: 2.20 time: 0.056996 Aug 29 20:19:01.366427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 313/638] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:01 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:19:01.376338 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4dd57a50-d464-4ade-af63-45bb57b36e1d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '.version_select at 0x7f15f9e06820>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:01.409451 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4dd57a50-d464-4ade-af63-45bb57b36e1d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659995797" status: 204 len: 0 microversion: 2.20 time: 0.037539 Aug 29 20:19:01.410097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 326/639] 10.222.0.73 () {60 vars in 1259 bytes} [Mon Aug 29 20:19:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659995797 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 20:19:02.011901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-7a4873ac-6276-4d61-b642-e2cfec997350 req-da1a01fd-8b7b-4b3d-ac43-e887565d1e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15272b1d-3321-42a2-9812-a4c28ac47708", "tag": "2b37a22d-175b-4c8c-a293-774e1c96bca8"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:02.023494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-7a4873ac-6276-4d61-b642-e2cfec997350 req-da1a01fd-8b7b-4b3d-ac43-e887565d1e6a service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.024587 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-7a4873ac-6276-4d61-b642-e2cfec997350 req-da1a01fd-8b7b-4b3d-ac43-e887565d1e6a service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.025363 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-7a4873ac-6276-4d61-b642-e2cfec997350 req-da1a01fd-8b7b-4b3d-ac43-e887565d1e6a service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.041502 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-7a4873ac-6276-4d61-b642-e2cfec997350 req-da1a01fd-8b7b-4b3d-ac43-e887565d1e6a service nova] Creating event network-changed:2b37a22d-175b-4c8c-a293-774e1c96bca8 for instance 15272b1d-3321-42a2-9812-a4c28ac47708 on hv-cinder-85426 Aug 29 20:19:02.048492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-7a4873ac-6276-4d61-b642-e2cfec997350 req-da1a01fd-8b7b-4b3d-ac43-e887565d1e6a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041065 Aug 29 20:19:02.050843 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 314/640] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:02.328520 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:02.329222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:02.337078 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.337573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.338031 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.338736 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.339413 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.340058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.360172 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3b79de84-30f4-4800-a36c-20cdbeee638f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'create', calling method: .version_select at 0x7f15f9d60af0>, body: {"keypair": {"name": "tempest-keypair-1039160063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFob4AhpEVpTfCPZtzHrUeVB9XZzWPc7mWOsJQNHXCiSUKADe9up7+keSCsz/k8AtYVyZarysUK/eME5NmiZ18AGLZYqEAzIYT7Ni2ynuyCpjHhbE37pHMO0UA1bMRmbA=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:02.382642 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-3b79de84-30f4-4800-a36c-20cdbeee638f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Getting quotas for project fc733dcfcf9043feb354598fc2792ff5. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:19:02.386685 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-3b79de84-30f4-4800-a36c-20cdbeee638f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Getting quotas for user 1ffc617c50984f83adc3269b118c8a91 and project fc733dcfcf9043feb354598fc2792ff5. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:19:02.411518 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3b79de84-30f4-4800-a36c-20cdbeee638f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057629 Aug 29 20:19:02.412108 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 315/641] 10.222.0.73 () {62 vars in 1200 bytes} [Mon Aug 29 20:19:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:02.417145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:02.418077 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:02.427555 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.429277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.429277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.429850 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.431220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.431740 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.582800 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:02.591136 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ee4659c2-412a-4a43-aeb6-c7f255b58855 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.266334 Aug 29 20:19:02.591967 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 327/642] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:02 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:02.671483 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:02.682481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-29995677-4417-4e69-91a8-8bd366cc01e2 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1363 microversion: 2.1 time: 0.269057 Aug 29 20:19:02.683894 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 316/643] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:02 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:03.613299 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:03.614253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:03.620960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.621433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.621907 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.622634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.623055 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.623467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.719025 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:03.720360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:03.728682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.729263 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.729785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.730548 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.731118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.731782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.827407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=8 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:03.955644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:03.970602 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-96e8cb73-72a8-4b5f-a13b-fb26572f073b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.361463 Aug 29 20:19:03.972177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 328/644] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:03 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:04.075479 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:04.089609 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2ddb7a0d-4290-4007-b1eb-7c13a9abeffc tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1363 microversion: 2.1 time: 0.377039 Aug 29 20:19:04.091984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 317/645] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:03 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:04.249822 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1724106395", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0d72436-11cb-4b65-af1f-b46234f8df90"}], "security_groups": [{"name": "tempest-securitygroup--985510362"}], "key_name": "tempest-keypair-1039160063", "user_data": "}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:04.430803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] validate_networks() for [('f0d72436-11cb-4b65-af1f-b46234f8df90', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:19:04.844628 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:19:04.845654 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:19:04.847086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:19:04.847907 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:19:04.848722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:19:04.851399 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:04.861234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:04.862730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:04.863243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:04.863981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:04.864435 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:04.864861 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:04.884891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Getting quotas for project fc733dcfcf9043feb354598fc2792ff5. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:19:04.888984 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Getting quotas for user 1ffc617c50984f83adc3269b118c8a91 and project fc733dcfcf9043feb354598fc2792ff5. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:19:04.904229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:19:04.906616 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:19:04.959565 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-142ca76c-726f-45c0-9c29-95fcca61fe19 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.714253 Aug 29 20:19:04.960436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 329/646] 10.222.0.73 () {62 vars in 1188 bytes} [Mon Aug 29 20:19:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 20:19:04.970922 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-d51e0765-88f3-41c0-b6f9-c5eb4cb5fa79 req-0412b013-bda8-47af-9922-da9a7775441b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa729ec-2c90-4d71-ab0a-23d73b1dd267", "name": "network-vif-plugged", "status": "completed", "tag": "211f234f-335d-4a0f-b293-03495489357e"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:04.977465 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-592031a6-6f0d-440c-9511-f735e9e1a5d9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:04.979583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-592031a6-6f0d-440c-9511-f735e9e1a5d9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:05.005677 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d51e0765-88f3-41c0-b6f9-c5eb4cb5fa79 req-0412b013-bda8-47af-9922-da9a7775441b service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.006437 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d51e0765-88f3-41c0-b6f9-c5eb4cb5fa79 req-0412b013-bda8-47af-9922-da9a7775441b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.007510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d51e0765-88f3-41c0-b6f9-c5eb4cb5fa79 req-0412b013-bda8-47af-9922-da9a7775441b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:05.023559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-d51e0765-88f3-41c0-b6f9-c5eb4cb5fa79 req-0412b013-bda8-47af-9922-da9a7775441b service nova] Creating event network-vif-plugged:211f234f-335d-4a0f-b293-03495489357e for instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 on hv-cinder-85426 Aug 29 20:19:05.029315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-d51e0765-88f3-41c0-b6f9-c5eb4cb5fa79 req-0412b013-bda8-47af-9922-da9a7775441b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062001 Aug 29 20:19:05.030678 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 318/647] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:05.038308 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:05.039470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:05.047071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.047584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.048238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:05.048984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.049547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.050074 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:05.063884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-592031a6-6f0d-440c-9511-f735e9e1a5d9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:05.078838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-592031a6-6f0d-440c-9511-f735e9e1a5d9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:05.087876 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-592031a6-6f0d-440c-9511-f735e9e1a5d9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:05.090716 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-592031a6-6f0d-440c-9511-f735e9e1a5d9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1282 microversion: 2.20 time: 0.118409 Aug 29 20:19:05.091228 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 330/648] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:04 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:05.119011 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:05.119963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:05.130390 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.131221 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.131839 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:05.132568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.133600 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.133600 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:05.282494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:05.294329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-93d6525e-4b47-4ceb-950a-889fc94d5ff7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.262260 Aug 29 20:19:05.294931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 319/649] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:05 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:05.398511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:05.414501 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-33c37790-c058-4122-8608-62fe3aaaa704 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1363 microversion: 2.1 time: 0.298814 Aug 29 20:19:05.418316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 331/650] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:05 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:06.118405 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:06.119006 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:06.126044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:06.126523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:06.126962 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.127752 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:06.128170 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:06.128593 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.211594 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:06.226238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:06.227734 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:06.228852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-448f24de-58d5-413d-be5a-6862c8cd2b33 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1278 microversion: 2.20 time: 0.116265 Aug 29 20:19:06.229414 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 320/651] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:06 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:06.321188 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:06.322420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:06.333342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:06.333873 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:06.334308 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.335252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:06.335709 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:06.336135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.455046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:06.456293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:06.463673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:06.464161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:06.464629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.465332 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:06.465810 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:06.466232 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.510156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:06.531250 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-fccd3519-7459-4f41-8c62-3fd6aac1eae0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1367 microversion: 2.1 time: 0.215090 Aug 29 20:19:06.545181 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 332/652] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:06 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:06.651240 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:06.660532 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f1f54cc5-c744-4a12-95af-63366f9a7bc0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1363 microversion: 2.1 time: 0.213239 Aug 29 20:19:06.661105 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 321/653] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:06 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:07.048888 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-f227cd48-8502-430f-bfb0-f1aa89fbd12d req-d9290bf5-c68f-492a-83d3-df2b51c8bec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15272b1d-3321-42a2-9812-a4c28ac47708", "name": "network-vif-plugged", "status": "completed", "tag": "2b37a22d-175b-4c8c-a293-774e1c96bca8"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:07.060208 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-f227cd48-8502-430f-bfb0-f1aa89fbd12d req-d9290bf5-c68f-492a-83d3-df2b51c8bec9 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.060693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-f227cd48-8502-430f-bfb0-f1aa89fbd12d req-d9290bf5-c68f-492a-83d3-df2b51c8bec9 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.061118 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-f227cd48-8502-430f-bfb0-f1aa89fbd12d req-d9290bf5-c68f-492a-83d3-df2b51c8bec9 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.072435 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-f227cd48-8502-430f-bfb0-f1aa89fbd12d req-d9290bf5-c68f-492a-83d3-df2b51c8bec9 service nova] Creating event network-vif-plugged:2b37a22d-175b-4c8c-a293-774e1c96bca8 for instance 15272b1d-3321-42a2-9812-a4c28ac47708 on hv-cinder-85426 Aug 29 20:19:07.081785 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-f227cd48-8502-430f-bfb0-f1aa89fbd12d req-d9290bf5-c68f-492a-83d3-df2b51c8bec9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037265 Aug 29 20:19:07.082412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 333/654] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:07.266510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:07.267284 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:07.275362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.275843 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.276271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.276966 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.277419 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.277872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.348994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:07.357175 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:07.358720 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:07.359899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0cfbc5b3-0d0e-43c1-bcb3-edeee74dca32 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1334 microversion: 2.20 time: 0.097384 Aug 29 20:19:07.360463 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 322/655] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:07 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:19:07.562209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:07.563046 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:07.569858 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.570354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.570790 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.571492 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.571944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.572389 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.685580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:07.686433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:07.688926 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:07.697481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.697995 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.698433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.699564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.699564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.699989 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.751548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:07.760375 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2a5ebc1d-b6b0-4b26-b0f8-3e9d094e9a78 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1558 microversion: 2.1 time: 0.202812 Aug 29 20:19:07.760978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 334/656] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:07 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:07.782534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:07.783117 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:07.790184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.790679 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.791112 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.791808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.792255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.792724 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.858730 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:07.867329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-195a5011-1791-4753-9bd5-882c13965ae3 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1363 microversion: 2.1 time: 0.186822 Aug 29 20:19:07.892331 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 323/657] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:07 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:07.927574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d26aab7f-763c-4fc3-afe8-580a4819abd9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148955 Aug 29 20:19:07.928132 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 335/658] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 29 20:19:07 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:19:08.385716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:08.386710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:08.396098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.396608 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.397034 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.397903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.398354 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.398862 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.761291 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:08.771392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:08.772859 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:08.774030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1e588a05-1cd1-448c-8d75-47ae4fee6b40 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1352 microversion: 2.20 time: 0.394771 Aug 29 20:19:08.774600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 324/659] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:08 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1352 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:08.900303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:08.901181 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:08.913168 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.914550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.915747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.917558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.918403 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.919214 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.079038 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:09.087798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7775ff9e-89a2-4428-a791-cafcde216e16 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1363 microversion: 2.1 time: 0.196205 Aug 29 20:19:09.088381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 336/660] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:08 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:09.804702 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:09.805372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:09.815779 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:09.816611 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:09.817010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.817801 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:09.818448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:09.819362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.907212 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-93d550b1-e6f5-423f-b397-3aebd997c3ef req-7aaf00ea-4df8-4039-88c1-e2cd20cf94a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa729ec-2c90-4d71-ab0a-23d73b1dd267", "tag": "211f234f-335d-4a0f-b293-03495489357e"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:09.932828 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:09.937400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-93d550b1-e6f5-423f-b397-3aebd997c3ef req-7aaf00ea-4df8-4039-88c1-e2cd20cf94a3 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:09.941843 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-93d550b1-e6f5-423f-b397-3aebd997c3ef req-7aaf00ea-4df8-4039-88c1-e2cd20cf94a3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:09.949643 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-93d550b1-e6f5-423f-b397-3aebd997c3ef req-7aaf00ea-4df8-4039-88c1-e2cd20cf94a3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.968099 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:09.974978 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:09.977853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ba446172-a0f5-4955-9a23-c9a2b244f666 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1340 microversion: 2.20 time: 0.177195 Aug 29 20:19:09.984499 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 325/661] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:09 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1340 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:10.017001 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-93d550b1-e6f5-423f-b397-3aebd997c3ef req-7aaf00ea-4df8-4039-88c1-e2cd20cf94a3 service nova] Creating event network-changed:211f234f-335d-4a0f-b293-03495489357e for instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 on hv-cinder-85426 Aug 29 20:19:10.035142 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-93d550b1-e6f5-423f-b397-3aebd997c3ef req-7aaf00ea-4df8-4039-88c1-e2cd20cf94a3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135794 Aug 29 20:19:10.037173 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 337/662] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:19:10.113686 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:10.117757 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:10.133212 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.135455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.136961 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.138010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.139395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.140003 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.514176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:10.529590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b0ba355f-f37b-4c0c-9728-f5f3bafe697c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1548 microversion: 2.1 time: 0.424155 Aug 29 20:19:10.547187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 326/663] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:10 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1548 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:10.571150 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:10.572574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:10.583178 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.584052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.584644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.585820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.586568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.587293 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.782634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9610cdd7-fe3e-40e6-97f5-aa17c025abe4 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.217724 Aug 29 20:19:10.796193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 338/664] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 29 20:19:10 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:11.037189 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:11.039614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:11.049848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:11.053977 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:11.055134 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:11.056210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:11.057687 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:11.058743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:11.059660 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:11.358120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:11.371107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:11.372782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:11.375590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9fe4d80f-6f5b-4ea1-9d55-c4b61cfc3320 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1407 microversion: 2.20 time: 0.346223 Aug 29 20:19:11.414220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 327/665] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:11 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:12.085290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-c4c1f6d7-db6a-4ed9-9b11-2e8b9f48d4c0 req-788d8804-bddb-4b93-acad-b4a25e29687d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4563b2-c0de-4300-be32-5faa8f8476d8", "tag": "1ab12c9b-86bb-41bd-aab2-ca30f835e85d"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:12.100836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c4c1f6d7-db6a-4ed9-9b11-2e8b9f48d4c0 req-788d8804-bddb-4b93-acad-b4a25e29687d service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.101614 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c4c1f6d7-db6a-4ed9-9b11-2e8b9f48d4c0 req-788d8804-bddb-4b93-acad-b4a25e29687d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.102305 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c4c1f6d7-db6a-4ed9-9b11-2e8b9f48d4c0 req-788d8804-bddb-4b93-acad-b4a25e29687d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.116776 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-c4c1f6d7-db6a-4ed9-9b11-2e8b9f48d4c0 req-788d8804-bddb-4b93-acad-b4a25e29687d service nova] Creating event network-changed:1ab12c9b-86bb-41bd-aab2-ca30f835e85d for instance eb4563b2-c0de-4300-be32-5faa8f8476d8 on hv-cinder-85426 Aug 29 20:19:12.122456 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-c4c1f6d7-db6a-4ed9-9b11-2e8b9f48d4c0 req-788d8804-bddb-4b93-acad-b4a25e29687d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050235 Aug 29 20:19:12.123405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 339/666] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:12.407920 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:12.408824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:12.412198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=20 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:12.420216 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.421048 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.421840 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.423010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.423788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.425050 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.612575 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:12.625397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:12.629615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:12.631613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-de3c9e66-3823-4195-8782-37374c32f246 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1407 microversion: 2.20 time: 0.228703 Aug 29 20:19:12.632887 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 328/667] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:12 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:12.650167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-e0278f54-96bc-4c41-8a05-b33f5c8e6138 req-34d5d021-e162-4684-8554-9fb15a4a558d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15272b1d-3321-42a2-9812-a4c28ac47708", "tag": "2b37a22d-175b-4c8c-a293-774e1c96bca8"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:12.663101 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e0278f54-96bc-4c41-8a05-b33f5c8e6138 req-34d5d021-e162-4684-8554-9fb15a4a558d service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.663677 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e0278f54-96bc-4c41-8a05-b33f5c8e6138 req-34d5d021-e162-4684-8554-9fb15a4a558d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.665444 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e0278f54-96bc-4c41-8a05-b33f5c8e6138 req-34d5d021-e162-4684-8554-9fb15a4a558d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.677811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-e0278f54-96bc-4c41-8a05-b33f5c8e6138 req-34d5d021-e162-4684-8554-9fb15a4a558d service nova] Creating event network-changed:2b37a22d-175b-4c8c-a293-774e1c96bca8 for instance 15272b1d-3321-42a2-9812-a4c28ac47708 on hv-cinder-85426 Aug 29 20:19:12.685175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-e0278f54-96bc-4c41-8a05-b33f5c8e6138 req-34d5d021-e162-4684-8554-9fb15a4a558d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040505 Aug 29 20:19:12.686230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 340/668] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:19:13.665371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:13.666948 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:13.680402 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:13.681296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:13.681982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:13.682936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:13.683638 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:13.684480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:13.967223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:13.978982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:13.981234 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:13.983029 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f6cce241-5322-45dc-ac88-fbb5548c7764 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1407 microversion: 2.20 time: 0.322090 Aug 29 20:19:13.998431 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 329/669] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:13 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:15.012912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:15.014373 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:15.019521 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:15.029145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.029893 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.030613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.031755 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.032521 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.033250 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.072482 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=8 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:15.199052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:15.210447 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:15.212022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:15.213250 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-38a15337-abbb-4578-a9bc-d4569a789e11 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1407 microversion: 2.20 time: 0.208279 Aug 29 20:19:15.213835 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 341/670] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:15 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:16.239126 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:16.240014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:16.246777 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.247315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.247785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.248619 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.249094 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.249515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.405513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.418316 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.420265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.421030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b24998fe-d2a9-4b64-8969-7f02442a14c9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1407 microversion: 2.20 time: 0.186218 Aug 29 20:19:16.421689 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 330/671] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:16 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:16.924388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-6d3a468f-495d-4ff7-93bb-7ec1170d4c74 req-8b7ac701-d5bb-4add-aed1-cb56715286f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4563b2-c0de-4300-be32-5faa8f8476d8", "name": "network-vif-plugged", "status": "completed", "tag": "1ab12c9b-86bb-41bd-aab2-ca30f835e85d"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:16.943590 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-6d3a468f-495d-4ff7-93bb-7ec1170d4c74 req-8b7ac701-d5bb-4add-aed1-cb56715286f1 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.944691 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-6d3a468f-495d-4ff7-93bb-7ec1170d4c74 req-8b7ac701-d5bb-4add-aed1-cb56715286f1 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.945053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-6d3a468f-495d-4ff7-93bb-7ec1170d4c74 req-8b7ac701-d5bb-4add-aed1-cb56715286f1 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.965885 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-6d3a468f-495d-4ff7-93bb-7ec1170d4c74 req-8b7ac701-d5bb-4add-aed1-cb56715286f1 service nova] Creating event network-vif-plugged:1ab12c9b-86bb-41bd-aab2-ca30f835e85d for instance eb4563b2-c0de-4300-be32-5faa8f8476d8 on hv-cinder-85426 Aug 29 20:19:16.974700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-6d3a468f-495d-4ff7-93bb-7ec1170d4c74 req-8b7ac701-d5bb-4add-aed1-cb56715286f1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057244 Aug 29 20:19:16.975457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 342/672] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:17.450535 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:17.451627 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:17.461145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.461890 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.462486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.463454 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.464236 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.464860 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.494787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:17.671150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:17.685895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:17.688708 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:17.690766 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2fe99cc9-841d-4d0f-8ac2-bce793acde59 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1407 microversion: 2.20 time: 0.247497 Aug 29 20:19:17.691743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 331/673] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:17 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:18.728880 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:18.729807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:18.736916 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:18.738460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:18.738962 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:18.739738 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:18.740237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:18.740713 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:18.926834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:18.935744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:18.937469 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:18.938688 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-671b2255-b2b3-4a29-81b5-b7bbdaa5617b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1407 microversion: 2.20 time: 0.215011 Aug 29 20:19:18.939247 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 343/674] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:18 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:19.966273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:19.966874 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:19.974058 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:19.974535 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:19.974964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:19.975652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:19.976109 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:19.976526 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.132569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:20.142251 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:20.144214 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:20.146049 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a1f1bddb-39ab-4533-8f36-85f958eedcf9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1599 microversion: 2.20 time: 0.183874 Aug 29 20:19:20.146791 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 332/675] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:19:19 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1599 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:19:20.172525 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:20.173135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:20.183873 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.184280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.184759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.185477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.186017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.186490 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.273180 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-07223f7a-7860-4d01-8dbe-20e0d1993586 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108032 Aug 29 20:19:20.273991 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 344/676] 10.222.0.73 () {60 vars in 1316 bytes} [Mon Aug 29 20:19:20 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:21.349476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-b87989ce-41e6-401e-a1ed-c4b2b51afc9f req-6f31712d-2bf0-4c40-8103-a63468b1fa7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4563b2-c0de-4300-be32-5faa8f8476d8", "tag": "1ab12c9b-86bb-41bd-aab2-ca30f835e85d"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:21.360022 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b87989ce-41e6-401e-a1ed-c4b2b51afc9f req-6f31712d-2bf0-4c40-8103-a63468b1fa7b service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:21.360504 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b87989ce-41e6-401e-a1ed-c4b2b51afc9f req-6f31712d-2bf0-4c40-8103-a63468b1fa7b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:21.361108 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b87989ce-41e6-401e-a1ed-c4b2b51afc9f req-6f31712d-2bf0-4c40-8103-a63468b1fa7b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:21.374322 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-b87989ce-41e6-401e-a1ed-c4b2b51afc9f req-6f31712d-2bf0-4c40-8103-a63468b1fa7b service nova] Creating event network-changed:1ab12c9b-86bb-41bd-aab2-ca30f835e85d for instance eb4563b2-c0de-4300-be32-5faa8f8476d8 on hv-cinder-85426 Aug 29 20:19:21.380382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-b87989ce-41e6-401e-a1ed-c4b2b51afc9f req-6f31712d-2bf0-4c40-8103-a63468b1fa7b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034833 Aug 29 20:19:21.381302 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 333/677] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:26.321098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:26.321818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:26.328162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:26.328983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:26.329779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.330848 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:26.332054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:26.332667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.358765 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lazy-loading 'flavor' on Instance uuid 9470292c-17d1-47bf-9ea3-c5b0eb069a12 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:26.453624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c23fc7b8-c43d-41f9-ac6b-c28888a84c52 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "POST /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12/action" status: 202 len: 0 microversion: 2.1 time: 0.138824 Aug 29 20:19:26.454415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 345/678] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:19:26 2022] POST /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:19:26.468150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:26.468937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:26.476770 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:26.477215 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:26.477804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.478656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:26.479487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:26.480231 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.676274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:26.686508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a7ae6752-7246-4ac2-afbc-279361247a16 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.225204 Aug 29 20:19:26.687100 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 334/679] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:26 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:27.720794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:27.721400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:27.727902 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:27.728374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:27.728803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:27.729520 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:27.730005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:27.730424 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:27.892404 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:27.910353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6ae53e9f-c177-410e-8aae-691d2b7d6598 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.190397 Aug 29 20:19:27.910353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 346/680] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:27 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:28.933773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:28.934868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:28.943920 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:28.944400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:28.944834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:28.945580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:28.946054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:28.946478 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:29.119686 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:29.128756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-113d17f0-e0a9-4e57-a283-1b87ae210b82 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.201797 Aug 29 20:19:29.129368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 335/681] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:28 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:30.150954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:30.151818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:30.158070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:30.158560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:30.158983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:30.160219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:30.160690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:30.161106 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:30.166439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:30.327111 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:30.335773 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-100c68ff-f03f-4a07-9552-042cf788ef6b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.189264 Aug 29 20:19:30.336346 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 347/682] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:30 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:31.358860 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:31.359451 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:31.367046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:31.367527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:31.367963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:31.368653 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:31.369122 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:31.369541 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:31.542894 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:31.557120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fc7eeb85-36e4-41e6-98aa-5a23e7f270a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.202194 Aug 29 20:19:31.573894 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 336/683] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:31 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:32.594318 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:32.594968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:32.602869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:32.603392 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:32.603820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:32.604533 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:32.604986 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:32.605410 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:32.761414 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:32.770516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5a4f47df-0b4d-4a13-837b-501c9d71dc13 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.180786 Aug 29 20:19:32.771100 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 348/684] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:32 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:33.798472 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:33.799326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:33.808492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:33.809323 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:33.810107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:33.811285 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:33.812095 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:33.812837 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:34.243804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:34.252105 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d0692223-fd0c-4492-84bf-dc7f38ed7b11 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.461423 Aug 29 20:19:34.252667 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 337/685] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:33 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:35.279901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.281020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:35.286077 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:35.295190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:35.295734 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:35.296447 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:35.297523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:35.298095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:35.298585 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:35.468044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:35.481667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1c657b8e-a0aa-44a3-92e8-d428b42fafa6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.208666 Aug 29 20:19:35.482518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 349/686] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:36.509423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:36.510350 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:36.519348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:36.519348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:36.520250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:36.520772 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:36.521307 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:36.521850 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:36.683848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:36.697957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c2403799-4cf4-4ec0-a580-46ab4d1544a7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.192338 Aug 29 20:19:36.698962 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 338/687] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:36 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:37.726388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:37.727189 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:37.736249 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:37.738552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:37.738552 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:37.739723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:37.739723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:37.740143 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:37.939092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:37.951270 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-389cef97-7dbc-4cd3-9bc7-7e315a19f921 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.228812 Aug 29 20:19:37.952044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 350/688] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:37 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:38.992994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:38.993601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:39.000802 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:39.001283 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:39.001827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:39.002577 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:39.003026 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:39.003938 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:39.188776 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:39.198004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-496fc419-6acc-4ac1-9eb7-be23839957c5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.211259 Aug 29 20:19:39.198768 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 339/689] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:38 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:40.227495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:40.228324 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:40.234952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:40.235474 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:40.235945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:40.236826 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:40.237349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:40.238795 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:40.396317 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:40.409718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-57247c56-28af-4960-ab55-db832eacc9a0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.187327 Aug 29 20:19:40.410853 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 351/690] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:40 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:41.433796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:41.434411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:41.437839 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=26 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:41.444731 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:41.445217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:41.445655 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:41.446486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:41.446886 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:41.447318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:41.615300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:41.624808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4f7f2412-aad7-4c85-bad2-bb459ab4f618 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.194768 Aug 29 20:19:41.625758 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 340/691] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:41 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:42.652107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:42.652869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:42.659763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:42.660321 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:42.660756 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:42.661459 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:42.661945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:42.662359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:42.826493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:42.836133 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0620493e-c4fe-49d9-abed-409e7fee6591 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1510 microversion: 2.1 time: 0.188431 Aug 29 20:19:42.836740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 352/692] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:42 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:42.859778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:42.860504 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:42.868004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:42.868489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:42.868917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:42.869630 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:42.870109 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:42.870531 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:42.923070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120788) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:19:43.004831 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c31388eb-a5ff-4e08-984a-c90ba865534b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "POST /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12/action" status: 202 len: 0 microversion: 2.1 time: 0.148956 Aug 29 20:19:43.005472 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 341/693] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:19:42 2022] POST /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:19:43.015679 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:43.016390 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:43.023596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:43.024125 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:43.024498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:43.025194 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:43.025636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:43.026097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:43.208131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:43.218585 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1b1b5976-46ef-4bbb-bda0-5011efc421f2 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1518 microversion: 2.1 time: 0.207394 Aug 29 20:19:43.219438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 353/694] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:43 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:44.255618 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:44.256230 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:44.263448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:44.263960 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:44.264392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:44.265088 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:44.265566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:44.266019 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:44.417369 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:44.438115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-31d9ccb1-5a6f-4f5f-b687-3d9fceaec0f7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1520 microversion: 2.1 time: 0.188635 Aug 29 20:19:44.438717 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 342/695] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:44 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:44.985432 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-61ea3ca0-a52b-4a19-b049-ecd49c56c47e req-76bf7d16-97d0-4dcb-8488-2ed31adb6dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9470292c-17d1-47bf-9ea3-c5b0eb069a12", "name": "network-vif-unplugged", "status": "completed", "tag": "e83470af-1797-4000-830e-cdec3cee207b"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:44.999464 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-61ea3ca0-a52b-4a19-b049-ecd49c56c47e req-76bf7d16-97d0-4dcb-8488-2ed31adb6dab service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:45.000519 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-61ea3ca0-a52b-4a19-b049-ecd49c56c47e req-76bf7d16-97d0-4dcb-8488-2ed31adb6dab service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:45.001222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-61ea3ca0-a52b-4a19-b049-ecd49c56c47e req-76bf7d16-97d0-4dcb-8488-2ed31adb6dab service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:45.023424 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.compute.server_external_events [req-61ea3ca0-a52b-4a19-b049-ecd49c56c47e req-76bf7d16-97d0-4dcb-8488-2ed31adb6dab service nova] Unable to find a host for instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12. Dropping event network-vif-unplugged {{(pid=120787) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 20:19:45.024334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-61ea3ca0-a52b-4a19-b049-ecd49c56c47e req-76bf7d16-97d0-4dcb-8488-2ed31adb6dab service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043289 Aug 29 20:19:45.024928 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 354/696] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 20:19:45.462270 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:45.463066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:45.470446 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:45.470996 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:45.471431 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:45.472833 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:45.473627 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:45.474385 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:45.650206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:45.658892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-642bb470-150a-4986-95eb-1e09be89b8d4 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.200886 Aug 29 20:19:45.659505 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 343/697] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:45 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:46.685781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:46.686593 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:46.694355 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:46.694942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:46.695418 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:46.696166 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:46.696665 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:46.697173 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:46.870540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:46.883707 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5c0a6953-9bac-4cdf-8359-ceb70e4605a1 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.204292 Aug 29 20:19:46.884727 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 355/698] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:46 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:47.907723 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:47.908451 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:47.915670 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:47.916152 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:47.916854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:47.917559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:47.918048 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:47.918469 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:47.921383 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:48.076655 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:48.087802 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6ed26867-f453-4e3a-95e2-19ccb9b8f8b7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.183714 Aug 29 20:19:48.088848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 344/699] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:47 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:49.116796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:49.117581 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:49.128200 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:49.129485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:49.129952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:49.130666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:49.131132 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:49.131562 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:49.311164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:49.320763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ce6b9315-635f-4e86-b4ab-7517bfc8602a tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.210994 Aug 29 20:19:49.321540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 356/700] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:49 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:50.354557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:50.355660 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:50.364113 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:50.364515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:50.364947 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:50.365652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:50.366139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:50.366560 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:50.548580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:50.558718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ca48efad-372e-4a73-bfdc-d0e88feaa62b tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.214531 Aug 29 20:19:50.559307 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 345/701] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:50 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:51.586310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:51.587407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:51.596756 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:51.598286 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:51.599385 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:51.601766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:51.601766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:51.601766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:51.754995 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:51.768589 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7620401f-d6f2-4e6e-af6d-19509b68ad17 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.187738 Aug 29 20:19:51.770169 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 357/702] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:51 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:52.795789 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:52.796328 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:52.803325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:52.803811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:52.804252 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:52.805244 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:52.805428 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:52.805853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:52.980798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:52.988980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b33de861-6a95-4fa1-9002-e3bd249541eb tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.197515 Aug 29 20:19:52.989865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 346/703] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:52 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:54.013453 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:54.014478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:54.022208 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:54.022660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:54.023086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:54.023780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:54.024231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:54.024656 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:54.190794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:54.199225 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cd25b25f-e253-4451-8502-24030fa6de75 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.192066 Aug 29 20:19:54.199798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 358/704] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:54 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:55.221149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:55.221903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:55.229646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:55.230177 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:55.230623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:55.231355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:55.231814 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:55.232252 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:55.402548 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:55.413251 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4555e662-d7c3-4454-a5b4-648a331ec3a6 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.195901 Aug 29 20:19:55.414056 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 347/705] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:55 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:56.440621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:56.442328 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:56.454108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:56.455018 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:56.455804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:56.457663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:56.458519 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:56.459287 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:56.642404 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:56.657078 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-52069e41-4e7c-4ed7-b9ac-ab45bc0f00b0 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.223354 Aug 29 20:19:56.658660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 359/706] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:56 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:57.104568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-c91fbefa-e70a-4de9-ae97-0ba425132fbc req-83675c13-e0c4-4734-9dd7-ab2184238730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9470292c-17d1-47bf-9ea3-c5b0eb069a12", "name": "network-vif-plugged", "status": "completed", "tag": "e83470af-1797-4000-830e-cdec3cee207b"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:57.123482 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c91fbefa-e70a-4de9-ae97-0ba425132fbc req-83675c13-e0c4-4734-9dd7-ab2184238730 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:57.124355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c91fbefa-e70a-4de9-ae97-0ba425132fbc req-83675c13-e0c4-4734-9dd7-ab2184238730 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:57.125133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c91fbefa-e70a-4de9-ae97-0ba425132fbc req-83675c13-e0c4-4734-9dd7-ab2184238730 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:57.142922 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-c91fbefa-e70a-4de9-ae97-0ba425132fbc req-83675c13-e0c4-4734-9dd7-ab2184238730 service nova] Creating event network-vif-plugged:e83470af-1797-4000-830e-cdec3cee207b for instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 on hv-cinder-85426 Aug 29 20:19:57.149492 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-c91fbefa-e70a-4de9-ae97-0ba425132fbc req-83675c13-e0c4-4734-9dd7-ab2184238730 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052262 Aug 29 20:19:57.150361 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 348/707] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:57.585947 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:57.586584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:57.595595 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:57.596075 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:57.596506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:57.597431 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:57.598657 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:57.599239 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:57.632864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7eb469ff-abfb-4243-8d01-90f519f9341c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/ips" status: 200 len: 149 microversion: 2.1 time: 0.051769 Aug 29 20:19:57.633731 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 360/708] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:19:57 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:57.690425 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:57.691811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:57.700665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:57.701953 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:57.702193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:57.703165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:57.703670 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:57.704102 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:57.917673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:57.931799 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-44a253cb-2d5d-4c57-9431-92197bbd7c66 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.246005 Aug 29 20:19:57.933783 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 349/709] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:57 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:58.895422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:58.896325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:58.904483 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:58.905114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:58.905684 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:58.906549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:58.907093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:58.907609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:58.934227 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f7af2f55-31ac-4796-bf2c-b8eb1a099178 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/ips" status: 200 len: 144 microversion: 2.1 time: 0.044932 Aug 29 20:19:58.934931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 361/710] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:19:58 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:58.967936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:58.968914 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:58.977340 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:58.978119 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:58.978701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:58.979532 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:58.980133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:58.980755 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:59.197811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:59.209589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2d34160d-ee2b-4bd4-bd8e-709f91eb8b31 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1576 microversion: 2.1 time: 0.245672 Aug 29 20:19:59.210519 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 350/711] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:19:58 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:59.254980 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3eb3041b-2900-4252-be66-9aa23e45055a"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:59.257795 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:59.266300 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:59.266969 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:59.267610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:59.268504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:59.269254 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:59.270162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:00.053171 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b5fc6dd3-5c41-45c1-9b29-0e960f5e6eb8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805262 Aug 29 20:20:00.053933 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 362/712] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:19:59 2022] POST /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:00.249898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:00.251314 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:00.263623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:00.264505 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:00.265302 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:00.266584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:00.267418 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:00.268189 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:00.468490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:00.473350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3149181c-eca7-42ef-b5e5-2a9173046e6b"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:00.477213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:00.482172 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b4edf3c9-b817-4c1f-9e7c-b086e00733f5 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1563 microversion: 2.1 time: 0.239389 Aug 29 20:20:00.483047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 351/713] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:00 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:00.486167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:00.486755 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:00.487192 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:00.487985 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:00.489305 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:00.489953 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:00.493127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:00.898583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-07150788-e3d9-4af6-acca-93450919d3f6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432253 Aug 29 20:20:00.899384 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 363/714] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:20:00 2022] POST /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:20:06.460903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:06.461546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:06.468140 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:06.468624 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:06.469058 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:06.469793 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:06.470247 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:06.470674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:06.508036 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eb5d3d69-2948-4ab9-828a-df7d6a02480a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/ips" status: 200 len: 152 microversion: 2.20 time: 0.111939 Aug 29 20:20:06.508986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 352/715] 10.222.0.73 () {60 vars in 1289 bytes} [Mon Aug 29 20:20:06 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/ips => generated 152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:07.752668 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4e06dbc1-f453-4dff-be7d-88a8b934f4dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: .version_select at 0x7f15f9cc2430>, body: {"keypair": {"name": "tempest-keypair-1333429671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyPpNStOuFa70AyOHKFt2xQrYA6FqlEcwMAMv0MvdG7TZTYWUIUAuroFZ3LyvH2LdhDToTTN1wwY6rbOY4huvOUfmBMiTLYTAv2D06Fv+Mf+V3dWdslJLSojpn6KrCIzQ=="}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:07.759590 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=30 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:07.774070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-4e06dbc1-f453-4dff-be7d-88a8b934f4dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:20:07.778378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-4e06dbc1-f453-4dff-be7d-88a8b934f4dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for user c7c8422c3d314adca25acf967ffd0998 and project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'key_pairs'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:20:07.811616 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4e06dbc1-f453-4dff-be7d-88a8b934f4dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063799 Aug 29 20:20:07.812745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 364/716] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:20:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:20:09.365968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:09.366828 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:09.374395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:09.374956 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:09.375675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:09.376442 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:09.377084 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:09.377519 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:09.429551 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lazy-loading 'flavor' on Instance uuid eb4563b2-c0de-4300-be32-5faa8f8476d8 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:20:09.547738 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-103764112", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68f99afd-3890-4bbb-ac8f-4e5af64abbb6"}], "security_groups": [{"name": "tempest-securitygroup--82985501"}], "key_name": "tempest-keypair-1333429671", "user_data": "}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:09.706523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] validate_networks() for [('68f99afd-3890-4bbb-ac8f-4e5af64abbb6', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:20:09.793219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13fccb5f-dab3-4eeb-ac6e-b26d292b4aa5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/action" status: 202 len: 0 microversion: 2.20 time: 0.431310 Aug 29 20:20:09.794044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 353/717] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 29 20:20:09 2022] POST /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:20:09.804999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:09.805727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:09.814432 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:09.815365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:09.815566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:09.816541 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:09.817115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:09.817557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:10.008207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:10.017245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:10.019088 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:10.021529 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-68ef7737-737b-4170-9eba-c0ec54d93919 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.222288 Aug 29 20:20:10.022823 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 354/718] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:09 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:20:10.273674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:20:10.274209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:20:10.274719 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:20:10.275196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:20:10.275663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:20:10.286545 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:10.287020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:10.287449 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:10.288264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:10.288703 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:10.289119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:10.314138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:20:10.318934 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for user c7c8422c3d314adca25acf967ffd0998 and project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:20:10.330138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:20:10.333122 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:20:10.383385 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c32fbafa-8550-48b0-9224-895f05a47e71 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.842555 Aug 29 20:20:10.384534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 365/719] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:20:09 2022] POST /compute/v2.1/servers => generated 400 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:20:10.404330 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-74bea6d1-f96e-4faa-8a3b-abfbe2ee7d0d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:10.406745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-74bea6d1-f96e-4faa-8a3b-abfbe2ee7d0d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:10.479206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-74bea6d1-f96e-4faa-8a3b-abfbe2ee7d0d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:10.488071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-74bea6d1-f96e-4faa-8a3b-abfbe2ee7d0d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1241 microversion: 2.1 time: 0.090735 Aug 29 20:20:10.488810 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 355/720] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:10 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:11.058697 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:11.059833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:11.072211 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:11.072624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:11.073353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:11.074238 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:11.074700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:11.075196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:11.281911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:11.295575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:11.298076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:11.299378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-53ca7f47-0dbe-496d-badc-283c8a8f4279 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.249183 Aug 29 20:20:11.299974 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 366/721] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:11 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:20:11.522264 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:11.523231 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:11.527248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:11.543329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:11.544234 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:11.545042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:11.546411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:11.547262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:11.547946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:11.650114 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:11.662438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d1481148-fd82-4843-9cda-55968f078e25 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1293 microversion: 2.1 time: 0.147566 Aug 29 20:20:11.663355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 356/722] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:11 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:12.329383 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:12.331438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:12.345457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:12.346415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:12.347234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:12.348836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:12.349422 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:12.349884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:12.575924 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:12.590781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:12.592607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:12.594182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8057f005-34fb-4cb0-9688-a2bcc87a6484 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.271243 Aug 29 20:20:12.595006 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 367/723] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:12 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:20:12.694490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:12.695476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:12.706273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:12.707301 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:12.709215 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:12.710192 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:12.710710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:12.711335 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:12.858974 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:12.873642 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c5cc3087-0466-41c1-aca8-a7b57c18ee0a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1299 microversion: 2.1 time: 0.184464 Aug 29 20:20:12.875101 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 357/724] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:12 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:20:13.634873 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:13.636007 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:13.643937 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:13.645878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:13.646583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:13.647760 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:13.648689 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:13.649352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:13.871331 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:13.885323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:13.888143 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:13.890319 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dc8bb74d-1c0d-4b17-98d0-3caed22338fa tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.263302 Aug 29 20:20:13.892890 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 368/725] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:13 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:20:13.927281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:13.928851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:13.939908 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:13.940744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:13.942044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:13.944034 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:13.944857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:13.945574 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:14.276542 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:14.288595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9071ae5f-c77d-4f51-938f-73e2e68f8ed2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1365 microversion: 2.1 time: 0.375245 Aug 29 20:20:14.289678 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 358/726] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:13 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:14.641637 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-e9ad466f-e924-4cd9-ac46-d632895246d7 req-4f794121-af66-4f3e-a3c6-fe74df33376b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30c5f72-8898-482c-85c6-2556a5d7df9d", "tag": "b4e00c26-8522-48f6-9ab5-604edc4776b4"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:14.669019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e9ad466f-e924-4cd9-ac46-d632895246d7 req-4f794121-af66-4f3e-a3c6-fe74df33376b service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:14.670253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e9ad466f-e924-4cd9-ac46-d632895246d7 req-4f794121-af66-4f3e-a3c6-fe74df33376b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:14.671162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e9ad466f-e924-4cd9-ac46-d632895246d7 req-4f794121-af66-4f3e-a3c6-fe74df33376b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:14.690924 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-e9ad466f-e924-4cd9-ac46-d632895246d7 req-4f794121-af66-4f3e-a3c6-fe74df33376b service nova] Creating event network-changed:b4e00c26-8522-48f6-9ab5-604edc4776b4 for instance f30c5f72-8898-482c-85c6-2556a5d7df9d on hv-cinder-85426 Aug 29 20:20:14.697869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-e9ad466f-e924-4cd9-ac46-d632895246d7 req-4f794121-af66-4f3e-a3c6-fe74df33376b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063448 Aug 29 20:20:14.698682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 369/727] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:20:14.929050 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:14.930108 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:14.940035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:14.940740 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:14.942463 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:14.944223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:14.944930 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:14.945732 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.217660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:15.221580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:15.230838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:15.231662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:15.232170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.233336 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:15.234109 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:15.234851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.275324 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:15.292089 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:15.293352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-52f13181-8c3b-41b1-85df-4e81ccd6c4ad tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081493 Aug 29 20:20:15.295708 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:15.297970 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e97ff94d-e348-4d13-9f5f-ee1ceac152ae tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.375618 Aug 29 20:20:15.298195 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 370/728] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:20:15 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:20:15.299446 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 359/729] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:14 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:15.325692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:15.326943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:15.332148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:15.335445 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:15.341674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:15.342868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:15.343698 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.344650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:15.345121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:15.345552 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.346418 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:15.347248 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:15.348323 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.349550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:15.350290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:15.351461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.404826 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7b4ae97f-cbde-4dfa-be32-759b7612e367 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/3149181c-eca7-42ef-b5e5-2a9173046e6b" status: 200 len: 194 microversion: 2.1 time: 0.098004 Aug 29 20:20:15.406307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 371/730] 10.222.0.73 () {58 vars in 1413 bytes} [Mon Aug 29 20:20:15 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/3149181c-eca7-42ef-b5e5-2a9173046e6b => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:20:15.937927 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:15.941077 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:15.952233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6a1b6665-6962-4de0-852e-9787d4314f6c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1365 microversion: 2.1 time: 0.636469 Aug 29 20:20:15.952824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 360/731] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:15 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1365 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:16.346278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:16.347066 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:16.355260 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:16.355744 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:16.356203 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:16.356919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:16.357367 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:16.357818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:16.553266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:16.564505 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:16.565984 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:16.567526 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d107bb71-06a3-4bb7-bddb-b2c635f8be3e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.227489 Aug 29 20:20:16.568093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 372/732] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:16 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:16.903250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6335114-cb09-4f27-8236-dd71b68b02a5"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:16.905960 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:16.915384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:16.915887 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:16.916329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:16.917052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:16.917510 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:16.917975 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:16.988513 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:16.990242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:17.001029 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:17.001764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:17.002498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:17.003764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:17.004650 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:17.005363 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:17.197458 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:17.205844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e4b1b960-4e7f-49c0-b635-952019296126 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1365 microversion: 2.1 time: 0.226198 Aug 29 20:20:17.206425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 373/733] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:16 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:20:17.483182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-33979b6d-8ec1-4be7-88f7-baadb43f92b0 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "POST /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584394 Aug 29 20:20:17.484267 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 361/734] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:20:16 2022] POST /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:17.602365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:17.603530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:17.617034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:17.617945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:17.618641 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:17.619944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:17.620911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:17.621559 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:17.803686 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:17.812832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:17.814350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:17.815530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bcc0660d-3859-466a-8223-57a94a86bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.222404 Aug 29 20:20:17.816085 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 374/735] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:17 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:18.227947 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:18.228557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:18.235480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:18.235962 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:18.236394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:18.237100 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:18.237552 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:18.238005 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:18.391312 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:18.402800 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e8cd1767-e9da-4a9b-99c2-ff5e7a4427dd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1365 microversion: 2.1 time: 0.178816 Aug 29 20:20:18.403751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 362/736] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:18 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:18.845870 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:18.846565 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:18.853963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:18.854446 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:18.854878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:18.855586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:18.856032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:18.856481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:19.000797 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:19.009817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:19.011190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:19.012310 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ddf75ad9-d2aa-4401-86b1-d1e8b5fc6bf0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.170646 Aug 29 20:20:19.012858 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 375/737] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:18 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:19.425556 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:19.426784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:19.433615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:19.434152 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:19.434578 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:19.435265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:19.435707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:19.436120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:19.583978 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:19.591919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6af1946d-927b-4e5d-87de-a2b323592abb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1365 microversion: 2.1 time: 0.170144 Aug 29 20:20:19.592508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 363/738] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:19 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:20:20.037184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:20.037800 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:20.044779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:20.045266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:20.045791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:20.046525 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:20.047266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:20.047785 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:20.202907 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:20.212572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:20.214016 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:20.215185 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2afb769d-6811-4e20-9bf8-32e50a64c84b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.182571 Aug 29 20:20:20.215735 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 376/739] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:20 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:20.617001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:20.618129 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:20.622143 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:20.632104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:20.632587 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:20.633168 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:20.634149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:20.634631 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:20.635051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:20.789196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:20.798076 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-30c8dc2b-438b-45d3-a214-915bc24267f6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1365 microversion: 2.1 time: 0.187613 Aug 29 20:20:20.798854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 364/740] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:20 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:21.241976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:21.242629 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:21.244584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:21.245238 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=10 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:21.252648 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:21.253131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:21.253557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:21.254335 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:21.255189 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:21.255619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:21.278014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-a45b2d97-d50b-4b6f-8ed9-b478414cd80b req-f8c1752d-a788-4d97-8980-24adf6a5c445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30c5f72-8898-482c-85c6-2556a5d7df9d", "name": "network-vif-plugged", "status": "completed", "tag": "b4e00c26-8522-48f6-9ab5-604edc4776b4"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:21.289903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a45b2d97-d50b-4b6f-8ed9-b478414cd80b req-f8c1752d-a788-4d97-8980-24adf6a5c445 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:21.290460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a45b2d97-d50b-4b6f-8ed9-b478414cd80b req-f8c1752d-a788-4d97-8980-24adf6a5c445 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:21.290934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a45b2d97-d50b-4b6f-8ed9-b478414cd80b req-f8c1752d-a788-4d97-8980-24adf6a5c445 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:21.304248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-a45b2d97-d50b-4b6f-8ed9-b478414cd80b req-f8c1752d-a788-4d97-8980-24adf6a5c445 service nova] Creating event network-vif-plugged:b4e00c26-8522-48f6-9ab5-604edc4776b4 for instance f30c5f72-8898-482c-85c6-2556a5d7df9d on hv-cinder-85426 Aug 29 20:20:21.310985 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-a45b2d97-d50b-4b6f-8ed9-b478414cd80b req-f8c1752d-a788-4d97-8980-24adf6a5c445 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037265 Aug 29 20:20:21.312118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 365/741] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:21.436714 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:21.447014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:21.448537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:21.449957 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-07ad5149-9850-4dca-a01f-0cfbd75526b4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.213969 Aug 29 20:20:21.450549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 377/742] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:21 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:21.825853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:21.827994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:21.839968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:21.840454 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:21.840884 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:21.841601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:21.842084 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:21.842500 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:22.005503 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:22.013700 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-224fd7b8-8837-44d9-8014-0d0ac0f94f9f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1365 microversion: 2.1 time: 0.196078 Aug 29 20:20:22.014340 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 366/743] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:21 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:20:22.474425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:22.475032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:22.482020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:22.482514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:22.482962 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:22.483651 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:22.484107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:22.484527 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:22.657766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:22.667626 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:22.669345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:22.670604 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a7f4be6a-8457-4f1e-8765-18c406e7198c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.200215 Aug 29 20:20:22.671216 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 378/744] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:22 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:23.039703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:23.040666 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:23.048659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:23.049420 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:23.050133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:23.051830 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:23.052668 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:23.053143 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:23.216432 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:23.227398 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-35b259f6-2942-4b63-8d97-d7a5d634ca7b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1365 microversion: 2.1 time: 0.193683 Aug 29 20:20:23.228387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 367/745] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:23 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:23.700603 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:23.701943 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:23.714788 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:23.715356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:23.715823 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:23.716969 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:23.717836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:23.718665 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:23.896440 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:23.914875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:23.916354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:23.917536 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-de860584-79f6-4fa7-bf64-2ae2c98b4ea5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.226029 Aug 29 20:20:23.918118 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 379/746] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:23 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:24.252834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:24.253770 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:24.261892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:24.262460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:24.265037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:24.265037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:24.265037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:24.265037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:24.450514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:24.461724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a50dc5c8-c0b2-421b-a2b2-293b3988a863 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1555 microversion: 2.1 time: 0.213709 Aug 29 20:20:24.462484 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 368/747] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:24 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1555 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:24.490955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:24.491833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:24.502353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:24.503264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:24.503958 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:24.505879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:24.506612 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:24.507044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:24.614634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ddd0d912-de30-4c40-b936-e5bac97d9808 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131715 Aug 29 20:20:24.615607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 380/748] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 29 20:20:24 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:24.950866 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:24.952125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:24.964293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:24.965147 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:24.965969 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:24.967241 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:24.968247 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:24.969005 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:25.202590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:25.219389 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:25.222642 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:25.226411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-432ebc04-ce48-4eae-8695-bc499b118e7d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.284272 Aug 29 20:20:25.228107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 369/749] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:24 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:26.250554 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-941ab6ca-5812-4e4e-a86c-a921d5ac90bb req-3a7dd88f-8cd7-4402-8f79-b4964a9c1d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30c5f72-8898-482c-85c6-2556a5d7df9d", "tag": "b4e00c26-8522-48f6-9ab5-604edc4776b4"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:26.264879 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:26.266037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:26.269349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-941ab6ca-5812-4e4e-a86c-a921d5ac90bb req-3a7dd88f-8cd7-4402-8f79-b4964a9c1d02 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.273347 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-941ab6ca-5812-4e4e-a86c-a921d5ac90bb req-3a7dd88f-8cd7-4402-8f79-b4964a9c1d02 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.273643 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.274182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.274617 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.275322 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.275773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.276185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.278125 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-941ab6ca-5812-4e4e-a86c-a921d5ac90bb req-3a7dd88f-8cd7-4402-8f79-b4964a9c1d02 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.296534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:26.299920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-941ab6ca-5812-4e4e-a86c-a921d5ac90bb req-3a7dd88f-8cd7-4402-8f79-b4964a9c1d02 service nova] Creating event network-changed:b4e00c26-8522-48f6-9ab5-604edc4776b4 for instance f30c5f72-8898-482c-85c6-2556a5d7df9d on hv-cinder-85426 Aug 29 20:20:26.307078 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-941ab6ca-5812-4e4e-a86c-a921d5ac90bb req-3a7dd88f-8cd7-4402-8f79-b4964a9c1d02 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064016 Aug 29 20:20:26.311046 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 381/750] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:26.318163 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:26.321232 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:26.334136 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.334983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.335561 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.336502 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.337314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.338150 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.398797 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e8aa32d8-8cfc-43e3-988c-060c37aae860 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.085903 Aug 29 20:20:26.404267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 382/751] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:20:26 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:26.568883 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:26.570013 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:26.570981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:26.585035 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.586610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.587621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.589370 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.590698 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.591983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.594700 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:26.599189 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:26.601563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-463aa2c1-e83b-4c0c-846e-9bcd421a3ec0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1745 microversion: 2.20 time: 0.343628 Aug 29 20:20:26.602563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 370/752] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:26 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1745 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:26.666663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-80ad9af9-c9c5-4e47-9291-004f399af95c tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/3149181c-eca7-42ef-b5e5-2a9173046e6b" status: 200 len: 194 microversion: 2.1 time: 0.106212 Aug 29 20:20:26.674187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 383/753] 10.222.0.73 () {58 vars in 1413 bytes} [Mon Aug 29 20:20:26 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/3149181c-eca7-42ef-b5e5-2a9173046e6b => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:26.685332 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:26.686275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:26.697955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.699299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.700962 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.702142 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:26.702812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:26.703320 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:26.834125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lazy-loading 'services' on Instance uuid 15272b1d-3321-42a2-9812-a4c28ac47708 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:20:26.942463 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13050a77-9084-46d2-ae89-692f197da3b6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/3149181c-eca7-42ef-b5e5-2a9173046e6b" status: 202 len: 0 microversion: 2.1 time: 0.262222 Aug 29 20:20:26.947857 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 371/754] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:20:26 2022] DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/3149181c-eca7-42ef-b5e5-2a9173046e6b => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:20:27.656064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:27.657409 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:27.664760 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:27.665243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:27.665918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:27.667182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:27.667810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:27.668413 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:27.884523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:27.908998 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:27.915090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:27.917742 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-08600bf9-7a0f-4a4a-ab24-066cf9cb357d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1745 microversion: 2.20 time: 0.265187 Aug 29 20:20:27.918759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 384/755] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:27 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1745 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:28.946550 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:28.947234 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:28.953464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:28.953978 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:28.954403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:28.955091 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:28.955541 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:28.955972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.136647 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:29.148467 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:29.149947 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:29.151411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5a162a2b-fbcb-4c11-983a-64019a30d92d tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.210690 Aug 29 20:20:29.161061 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 372/756] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:28 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:29.216538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:29.217114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:29.227177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.228150 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.229071 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.230955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.231954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.232661 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.283708 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9daf4e0a-fbc2-4d91-9616-aa32bc3dae33 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/a6335114-cb09-4f27-8236-dd71b68b02a5" status: 200 len: 194 microversion: 2.1 time: 0.071084 Aug 29 20:20:29.284810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 385/757] 10.222.0.73 () {58 vars in 1413 bytes} [Mon Aug 29 20:20:29 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/a6335114-cb09-4f27-8236-dd71b68b02a5 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:29.295878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:29.296753 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:29.304530 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.305148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.305880 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.306830 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.307494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.308132 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.415637 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lazy-loading 'services' on Instance uuid 15272b1d-3321-42a2-9812-a4c28ac47708 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:20:29.428964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-00c3c6d5-eb83-4622-91a4-0c209a13ea61 req-cd484075-8423-4c65-989f-52e68d026ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4563b2-c0de-4300-be32-5faa8f8476d8", "name": "network-vif-plugged", "status": "completed", "tag": "1ab12c9b-86bb-41bd-aab2-ca30f835e85d"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:29.443846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-00c3c6d5-eb83-4622-91a4-0c209a13ea61 req-cd484075-8423-4c65-989f-52e68d026ade service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.444676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-00c3c6d5-eb83-4622-91a4-0c209a13ea61 req-cd484075-8423-4c65-989f-52e68d026ade service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.445366 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-00c3c6d5-eb83-4622-91a4-0c209a13ea61 req-cd484075-8423-4c65-989f-52e68d026ade service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.493437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-00c3c6d5-eb83-4622-91a4-0c209a13ea61 req-cd484075-8423-4c65-989f-52e68d026ade service nova] Creating event network-vif-plugged:1ab12c9b-86bb-41bd-aab2-ca30f835e85d for instance eb4563b2-c0de-4300-be32-5faa8f8476d8 on hv-cinder-85426 Aug 29 20:20:29.498838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-00c3c6d5-eb83-4622-91a4-0c209a13ea61 req-cd484075-8423-4c65-989f-52e68d026ade service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074650 Aug 29 20:20:29.502784 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 386/758] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:20:29.581472 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0aa9d1f2-d06e-4058-92d3-72d141a9da61 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/a6335114-cb09-4f27-8236-dd71b68b02a5" status: 202 len: 0 microversion: 2.1 time: 0.290164 Aug 29 20:20:29.584157 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 373/759] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:20:29 2022] DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments/a6335114-cb09-4f27-8236-dd71b68b02a5 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:20:30.183812 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:30.191137 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:30.212798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:30.213740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:30.214468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:30.215739 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:30.216469 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:30.217015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:30.470672 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:30.479402 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:30.484980 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:30.486954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ce4cc16b-d3ea-459f-840e-6b4898f15b0e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.313987 Aug 29 20:20:30.488029 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 387/760] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:30 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:31.513848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:31.514920 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:31.523066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:31.523868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:31.524299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:31.526049 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:31.526798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:31.527765 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:31.733224 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:31.745478 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:31.747582 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:31.749070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3746d8e4-4785-4de8-a009-23471bebd5cf tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.240110 Aug 29 20:20:31.754883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 374/761] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:31 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:31.981844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:31.984940 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:31.994293 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:31.994831 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:31.995477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:31.996403 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:31.997086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:31.997823 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.042839 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6cb2a1ad-e367-4401-b65c-507f573e71d7 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065975 Aug 29 20:20:32.044632 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 388/762] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:20:31 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:20:32.190876 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:32.194086 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:32.200835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.201329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.201796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.202522 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.202990 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.203413 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.220140 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:32.252675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dd779c44-1ac4-428a-8173-424ab49c33fa tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065835 Aug 29 20:20:32.253325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 375/763] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:20:32 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:20:32.337663 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:32.338265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:32.345240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.345943 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.346378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.347136 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.347593 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.348061 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.380468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:20:32.483837 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1b1e344f-2d05-4e51-a813-e8fc4bc354a8 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 204 len: 0 microversion: 2.1 time: 0.150624 Aug 29 20:20:32.485750 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 389/764] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:20:32 2022] DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:20:32.494647 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:32.495378 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:32.503429 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.504237 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.505279 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.511028 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.511028 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.511028 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.711742 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:32.721777 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fc5f717c-9ad6-4ef4-ace7-9bb7ea6eedee tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1672 microversion: 2.1 time: 0.232091 Aug 29 20:20:32.722374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 376/765] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:32 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1672 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:32.781810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:32.782508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:32.790311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.790794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.791225 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.791916 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.792364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.792781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.999695 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:33.012855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:33.015254 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:33.017502 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-96fa02a0-31b5-412c-be13-16d459d94b4b tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.239961 Aug 29 20:20:33.018410 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 390/766] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:32 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:20:33.743749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:33.744340 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:33.751070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:33.751818 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:33.753305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:33.753305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:33.754014 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:33.755329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:33.982423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:33.992072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-36fd9993-a88c-4d73-b4a7-b354323c4cc6 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1672 microversion: 2.1 time: 0.252080 Aug 29 20:20:33.992634 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 377/767] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:33 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:34.050435 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:34.050990 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:34.058248 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:34.058748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:34.059172 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:34.060309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:34.060767 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:34.061180 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:34.247199 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:34.255821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:34.258500 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:34.260130 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7e29da90-006a-40f4-a31c-c8dc9303bc20 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.214306 Aug 29 20:20:34.260846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 391/768] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:34 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:35.027910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:35.028714 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:35.036897 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:35.037359 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:35.037827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:35.038566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:35.039033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:35.039440 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:35.286487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:35.299546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-744252ac-6827-4306-a51c-884bd69dc05e tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1672 microversion: 2.1 time: 0.289180 Aug 29 20:20:35.299825 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:35.300840 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 378/769] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:35 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1672 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:35.300978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:35.312572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:35.313307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:35.313856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:35.314983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:35.315634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:35.316338 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:35.511530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:35.529175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:35.532488 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:35.537639 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1af4e088-d8a4-4b6d-894a-7ccf08bdd7c5 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.242554 Aug 29 20:20:35.539068 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 392/770] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:35 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:36.338034 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:36.338729 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:36.346162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:36.346956 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:36.347390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:36.348639 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:36.349082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:36.349502 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:36.431488 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:36.445811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-861386df-69c2-46c9-b411-ef5700523cff tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1605 microversion: 2.1 time: 0.113340 Aug 29 20:20:36.448361 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 379/771] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:36 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1605 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:36.585638 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:36.587176 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:36.599723 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:36.600732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:36.602504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:36.603343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:36.603900 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:36.604429 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:36.760835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-d8c592e2-a5c2-4ce0-b48d-1583609aa8f6 req-b91edeee-7e7c-4050-9f21-c236522227de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15272b1d-3321-42a2-9812-a4c28ac47708", "name": "network-vif-deleted", "tag": "2b37a22d-175b-4c8c-a293-774e1c96bca8"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:36.799907 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d8c592e2-a5c2-4ce0-b48d-1583609aa8f6 req-b91edeee-7e7c-4050-9f21-c236522227de service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:36.804104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d8c592e2-a5c2-4ce0-b48d-1583609aa8f6 req-b91edeee-7e7c-4050-9f21-c236522227de service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:36.805913 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d8c592e2-a5c2-4ce0-b48d-1583609aa8f6 req-b91edeee-7e7c-4050-9f21-c236522227de service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:36.854295 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-d8c592e2-a5c2-4ce0-b48d-1583609aa8f6 req-b91edeee-7e7c-4050-9f21-c236522227de service nova] Creating event network-vif-deleted:2b37a22d-175b-4c8c-a293-774e1c96bca8 for instance 15272b1d-3321-42a2-9812-a4c28ac47708 on hv-cinder-85426 Aug 29 20:20:36.861275 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:36.869192 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-d8c592e2-a5c2-4ce0-b48d-1583609aa8f6 req-b91edeee-7e7c-4050-9f21-c236522227de service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120075 Aug 29 20:20:36.870373 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 380/772] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:36.875533 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:36.877523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:36.879276 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0bea7dcf-9df5-4c4c-98bd-217f0716a9d1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.299670 Aug 29 20:20:36.880475 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 393/773] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:36 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:37.482712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:37.483801 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:37.502648 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:37.503546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:37.504475 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:37.505866 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:37.506756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:37.507537 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:37.566180 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:37.572244 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:37.576421 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:37.577303 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lazy-loading 'fault' on Instance uuid 15272b1d-3321-42a2-9812-a4c28ac47708 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:20:37.673273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2aae2da284df29243b99d33725ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb06a5fd3a3482d991c542ccc993e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:37.687002 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ac49b8a7-6a2e-4705-8f3f-45f16c9cc8db tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 200 len: 1328 microversion: 2.1 time: 0.212178 Aug 29 20:20:37.704273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 381/774] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:37 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 1328 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:37.912353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:37.916734 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:37.935149 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:37.939941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:37.940715 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:37.945423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:37.946942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:37.947575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:37.948720 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:38.208608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:38.222977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:38.224878 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:38.232001 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8eea2cdd-a23e-41d3-b1e1-3db5e2e22284 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.329161 Aug 29 20:20:38.234084 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 394/775] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:37 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:38.724079 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:38.725740 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:38.734579 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:38.735477 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:38.736874 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:38.738010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:38.738641 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:38.739163 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:38.756853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] HTTP exception thrown: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Request method failure captured: Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 HTTP/1.1 Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR26ISzuDRmUxl5QZXR5ZzoR6ow0fkaUFAU4z1tMsEdgemR84k7gCtg_ZSGi9fvXSH8OHcvikiexMUpO8DZzythGahXzPAY2nD9iDGkudji1UojLbgXzpaBCwGyU9xORRem-kK2-UhUbdcMDhfX4my3bn3qEvWj8lEFkR2k4r7odObM Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:20:38.759010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6fb06a5fd3a3482d991c542ccc993e88"}]}] Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 04c2aae2da284df29243b99d33725ddd Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:38.762854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '15272b1d-3321-42a2-9812-a4c28ac47708'} Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:38.765068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:38.773744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:38.776137 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Returning 404 to user: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:38.776137 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f4921baf-5a09-4359-b86f-3039d430e9dd tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 404 len: 111 microversion: 2.1 time: 0.041019 Aug 29 20:20:38.776137 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 382/776] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:38 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:20:38.777073 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f91b8980-5f19-42a5-a380-81cbfa384493 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '.version_select at 0x7f15f9cd8160>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:38.802079 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f91b8980-5f19-42a5-a380-81cbfa384493 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764102717" status: 202 len: 0 microversion: 2.1 time: 0.028672 Aug 29 20:20:38.802794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 395/777] 10.222.0.73 () {58 vars in 1221 bytes} [Mon Aug 29 20:20:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764102717 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:20:39.260719 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:39.261230 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:39.268174 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:39.268911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:39.269493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:39.270479 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:39.271451 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:39.272071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:39.563358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:39.576426 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:39.578250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:39.580184 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6d36a6ba-59c0-44a8-a502-5d29b2d6cb17 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.323494 Aug 29 20:20:39.581652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 383/778] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:39 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:40.619146 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:40.620156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:40.627188 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:40.627673 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:40.628112 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:40.628804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:40.629463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:40.630619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:40.790055 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:40.799810 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:40.801979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:40.803387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-255bd6c1-b427-4787-ac75-0c3aced11367 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1740 microversion: 2.20 time: 0.189878 Aug 29 20:20:40.804135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 396/779] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:40 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:41.828394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:41.829137 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:41.831711 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=58 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:41.838979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:41.839629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:41.840300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:41.841514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:41.842197 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:41.842771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:42.070096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:42.082348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:42.085386 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:42.087132 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a7564a1e-e500-4562-bb0b-63a1f4765391 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1722 microversion: 2.20 time: 0.262948 Aug 29 20:20:42.087718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 384/780] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:41 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:42.287688 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:42.288388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:42.295259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:42.295733 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:42.296155 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:42.296838 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:42.297276 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:42.297762 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:42.312607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] HTTP exception thrown: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Request method failure captured: Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 HTTP/1.1 Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR26ISzuDRmUxl5QZXR5ZzoR6ow0fkaUFAU4z1tMsEdgemR84k7gCtg_ZSGi9fvXSH8OHcvikiexMUpO8DZzythGahXzPAY2nD9iDGkudji1UojLbgXzpaBCwGyU9xORRem-kK2-UhUbdcMDhfX4my3bn3qEvWj8lEFkR2k4r7odObM Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:20:42.314307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6fb06a5fd3a3482d991c542ccc993e88"}]}] Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 04c2aae2da284df29243b99d33725ddd Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.315919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '15272b1d-3321-42a2-9812-a4c28ac47708'} Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:42.317184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.319438 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.321518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Returning 404 to user: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:42.321518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-76d409c0-9bee-44ff-ac4a-713aee81e351 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 404 len: 111 microversion: 2.1 time: 0.033626 Aug 29 20:20:42.321518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 397/781] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:20:42 2022] DELETE /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:42.324825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:42.325481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 15272b1d-3321-42a2-9812-a4c28ac47708] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:42.331893 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:42.332384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:42.332812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:42.333514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:42.334009 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:42.334430 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:42.348965 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] HTTP exception thrown: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Request method failure captured: Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 HTTP/1.1 Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR26ISzuDRmUxl5QZXR5ZzoR6ow0fkaUFAU4z1tMsEdgemR84k7gCtg_ZSGi9fvXSH8OHcvikiexMUpO8DZzythGahXzPAY2nD9iDGkudji1UojLbgXzpaBCwGyU9xORRem-kK2-UhUbdcMDhfX4my3bn3qEvWj8lEFkR2k4r7odObM Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:20:42.350563 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6fb06a5fd3a3482d991c542ccc993e88"}]}] Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 04c2aae2da284df29243b99d33725ddd Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.352865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '15272b1d-3321-42a2-9812-a4c28ac47708'} Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:42.354304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. Aug 29 20:20:42.356527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.358674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Returning 404 to user: Instance 15272b1d-3321-42a2-9812-a4c28ac47708 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:42.358674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-71aca8e2-5093-4167-91f8-2526f2848c97 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708" status: 404 len: 111 microversion: 2.1 time: 0.031017 Aug 29 20:20:42.358674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 385/782] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:42 2022] GET /compute/v2.1/servers/15272b1d-3321-42a2-9812-a4c28ac47708 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:20:43.115774 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:43.116834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:43.125446 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.125965 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.126398 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.127095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.127542 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.127960 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.306893 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:43.319671 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:43.321365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:43.322599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f67a3984-6502-4f57-aa62-6b51a18d54c4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1722 microversion: 2.20 time: 0.214076 Aug 29 20:20:43.323163 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 398/783] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:43 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:43.368881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-08438507-f447-4ab4-a574-751f6fbd622c req-3d20011b-dc3f-4c1a-8891-5795e25ff7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4563b2-c0de-4300-be32-5faa8f8476d8", "name": "network-vif-unplugged", "status": "completed", "tag": "1ab12c9b-86bb-41bd-aab2-ca30f835e85d"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:43.379087 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-08438507-f447-4ab4-a574-751f6fbd622c req-3d20011b-dc3f-4c1a-8891-5795e25ff7a3 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.380269 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-08438507-f447-4ab4-a574-751f6fbd622c req-3d20011b-dc3f-4c1a-8891-5795e25ff7a3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.380710 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-08438507-f447-4ab4-a574-751f6fbd622c req-3d20011b-dc3f-4c1a-8891-5795e25ff7a3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.395061 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-08438507-f447-4ab4-a574-751f6fbd622c req-3d20011b-dc3f-4c1a-8891-5795e25ff7a3 service nova] Creating event network-vif-unplugged:1ab12c9b-86bb-41bd-aab2-ca30f835e85d for instance eb4563b2-c0de-4300-be32-5faa8f8476d8 on hv-cinder-85426 Aug 29 20:20:43.402353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-08438507-f447-4ab4-a574-751f6fbd622c req-3d20011b-dc3f-4c1a-8891-5795e25ff7a3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036968 Aug 29 20:20:43.403146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 386/784] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:43.523417 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:43.523909 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:43.530290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.530764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.531196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.531900 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.532351 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.532763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.535641 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:43.550747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] HTTP exception thrown: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Request method failure captured: Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: DELETE /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 HTTP/1.1 Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR26ISzuDRmUxl5QZXR5ZzoR6ow0fkaUFAU4z1tMsEdgemR84k7gCtg_ZSGi9fvXSH8OHcvikiexMUpO8DZzythGahXzPAY2nD9iDGkudji1UojLbgXzpaBCwGyU9xORRem-kK2-UhUbdcMDhfX4my3bn3qEvWj8lEFkR2k4r7odObM Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:20:43.552777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6fb06a5fd3a3482d991c542ccc993e88"}]}] Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 04c2aae2da284df29243b99d33725ddd Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.554364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '856657fa-097f-45c6-baeb-cc6a9d494a26'} Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:43.555732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.558186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.561290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Returning 404 to user: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:43.561290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-668dda33-f8e3-43bf-a502-cce481bc7040 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "DELETE /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 404 len: 111 microversion: 2.1 time: 0.034650 Aug 29 20:20:43.561290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 399/785] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:20:43 2022] DELETE /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:43.563671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:43.564363 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] [instance: 856657fa-097f-45c6-baeb-cc6a9d494a26] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:43.577861 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.578348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.578776 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.579487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.579916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.580460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.598405 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] HTTP exception thrown: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Request method failure captured: Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 HTTP/1.1 Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR26ISzuDRmUxl5QZXR5ZzoR6ow0fkaUFAU4z1tMsEdgemR84k7gCtg_ZSGi9fvXSH8OHcvikiexMUpO8DZzythGahXzPAY2nD9iDGkudji1UojLbgXzpaBCwGyU9xORRem-kK2-UhUbdcMDhfX4my3bn3qEvWj8lEFkR2k4r7odObM Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:20:43.600941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6fb06a5fd3a3482d991c542ccc993e88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6fb06a5fd3a3482d991c542ccc993e88"}]}] Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 6fb06a5fd3a3482d991c542ccc993e88 Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109797387 Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 04c2aae2da284df29243b99d33725ddd Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeTestJSON-1109797387-project Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.604110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '856657fa-097f-45c6-baeb-cc6a9d494a26'} Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:43.605583 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. Aug 29 20:20:43.607071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.608400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] Returning 404 to user: Instance 856657fa-097f-45c6-baeb-cc6a9d494a26 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:43.608400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5b3dd4a6-fa9a-4ef4-b2dc-43d008aecd26 tempest-AttachVolumeTestJSON-1109797387 tempest-AttachVolumeTestJSON-1109797387-project] 10.222.0.73 "GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26" status: 404 len: 111 microversion: 2.1 time: 0.043267 Aug 29 20:20:43.608400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 387/786] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:20:43 2022] GET /compute/v2.1/servers/856657fa-097f-45c6-baeb-cc6a9d494a26 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:44.349048 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.350004 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:44.357728 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.358208 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.358846 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.359553 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.360005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.360418 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.564692 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:44.579608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:44.581070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:44.582463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b12af7bd-7a1f-44f5-8c0e-a7a82a269ff3 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1722 microversion: 2.20 time: 0.238892 Aug 29 20:20:44.598876 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 400/787] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:44 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:45.619685 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:45.621145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:45.631818 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:45.632652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:45.633404 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:45.634712 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:45.635596 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:45.636297 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:45.842260 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:45.853033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:45.854658 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:45.855977 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d5adb959-9f5e-4e5b-a7f6-e5458925b035 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1665 microversion: 2.20 time: 0.243794 Aug 29 20:20:45.856552 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 388/788] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:45 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1665 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:45.881965 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96ac5812-c2be-4dbe-abbb-8a003824dc9b"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:45.885242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:45.894991 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:45.896283 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:45.896926 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:45.897697 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:45.898271 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:45.898790 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:46.316970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a6f6fe3a-0f1f-4086-b091-5c4b31078ba1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.439044 Aug 29 20:20:46.324178 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 401/789] 10.222.0.73 () {62 vars in 1364 bytes} [Mon Aug 29 20:20:45 2022] POST /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/os-volume_attachments => generated 188 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:46.507479 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:46.507979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:46.515759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:46.516177 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:46.516614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:46.518083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:46.518543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:46.518971 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:46.871000 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4630562c-354c-4f91-a815-77e74562c72c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "DELETE /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/os-volume_attachments/96ac5812-c2be-4dbe-abbb-8a003824dc9b" status: 202 len: 0 microversion: 2.20 time: 0.368836 Aug 29 20:20:46.871621 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 389/790] 10.222.0.73 () {60 vars in 1457 bytes} [Mon Aug 29 20:20:46 2022] DELETE /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/os-volume_attachments/96ac5812-c2be-4dbe-abbb-8a003824dc9b => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:20:46.972401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:46.974162 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:46.986110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:46.987384 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:46.988502 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:46.990836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:46.991959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:46.992902 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:47.046614 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120787) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:20:47.141526 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6ecc773d-a7a6-4c71-b103-8719c12cd6ed tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "POST /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/action" status: 202 len: 0 microversion: 2.20 time: 0.171419 Aug 29 20:20:47.143105 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 402/791] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 29 20:20:46 2022] POST /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:20:47.156922 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:47.170817 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:47.188934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:47.190133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:47.191353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:47.193297 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:47.194320 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:47.195268 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:47.569000 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:47.580430 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:47.584453 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:47.586878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ac191393-9808-43ee-aa8b-6a610baee871 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1673 microversion: 2.20 time: 0.439137 Aug 29 20:20:47.605618 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 390/792] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:47 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1673 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:48.613326 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:48.615279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:48.625976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:48.626932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:48.627582 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:48.628620 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:48.629529 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:48.630715 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:48.825161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:48.836177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:48.839402 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:48.841406 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7ca9ac69-afd3-4413-8be0-37f36f719862 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1675 microversion: 2.20 time: 0.232528 Aug 29 20:20:48.842917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 403/793] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:48 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:20:49.768194 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5c45418d-454b-4fad-98c8-53e6a39d2b66 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Action: 'create', calling method: .version_select at 0x7f15f9c68280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1579880318"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:49.868697 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:49.869401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:49.877401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:49.877941 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:49.878693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:49.881114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:49.881114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:49.881114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:50.034828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:50.048694 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:50.051434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:50.053500 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-99c0c2a3-e324-4150-813c-0370ebd8b09f tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.189954 Aug 29 20:20:50.073790 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 404/794] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:49 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:20:50.158133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5c45418d-454b-4fad-98c8-53e6a39d2b66 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.520307 Aug 29 20:20:50.159757 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 391/795] 10.222.0.73 () {60 vars in 1155 bytes} [Mon Aug 29 20:20:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 523 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 20:20:50.173571 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-fe0fe2b1-3ee9-451c-9ecf-afe9abebb0c4 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9c309d0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:50.237820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-fe0fe2b1-3ee9-451c-9ecf-afe9abebb0c4 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc" status: 200 len: 345 microversion: 2.1 time: 0.068657 Aug 29 20:20:50.238392 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 405/796] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:20:50 2022] GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:51.096907 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.100428 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:51.107794 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:51.108935 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:51.109532 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:51.110906 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:51.111905 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:51.113062 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:51.253887 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-135239aa-9ef1-4ac3-b783-8e2d7248b0d0 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9cd8790>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.292961 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:51.303953 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:51.305696 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:51.307999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bcf1bd19-8dc5-420f-a593-b8e809a9ad8e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.219749 Aug 29 20:20:51.309212 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 392/797] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:51.312594 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-135239aa-9ef1-4ac3-b783-8e2d7248b0d0 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc" status: 200 len: 346 microversion: 2.1 time: 0.063324 Aug 29 20:20:51.322304 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 406/798] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:20:51.327671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-863bc392-0adc-413e-84eb-5fccc35a374c tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Action: 'create', calling method: .version_select at 0x7f15f9c68670>, body: {"snapshot": {"volume_id": "891456f6-9e08-4b6f-af71-ba0bf78586fc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-992397781"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:51.532988 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-863bc392-0adc-413e-84eb-5fccc35a374c tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.208907 Aug 29 20:20:51.535696 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 393/799] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Aug 29 20:20:51 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:51.552209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3d1d4874-e074-465f-ac58-45ef823fa07d tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9c4c430>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.620974 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3d1d4874-e074-465f-ac58-45ef823fa07d tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 200 len: 286 microversion: 2.1 time: 0.076058 Aug 29 20:20:51.622088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 407/800] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:51.634066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b9bbf593-0433-4d65-b147-bc5e37efefbb tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9d3f790>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.679395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b9bbf593-0433-4d65-b147-bc5e37efefbb tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.049726 Aug 29 20:20:51.680357 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 394/801] 10.222.0.73 () {58 vars in 1140 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:51.696970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f25b6860-ed56-4098-b6a8-3b8f1ee53236 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9cd8700>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.740732 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f25b6860-ed56-4098-b6a8-3b8f1ee53236 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 200 len: 286 microversion: 2.1 time: 0.049278 Aug 29 20:20:51.741613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 408/802] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:52.341589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:52.342191 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:52.350568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:52.351398 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:52.352179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:52.353524 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:52.354381 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:52.355157 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:52.389896 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:52.545207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:52.555021 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:52.556531 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:52.557721 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2ba5f900-9476-46be-acff-59d61fca57ad tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.220701 Aug 29 20:20:52.558323 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 395/803] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:52 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:52.753534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-23a7eef4-9fa3-41ec-b658-94e11b7fc5a5 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9ca7e50>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:52.785267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-23a7eef4-9fa3-41ec-b658-94e11b7fc5a5 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 200 len: 286 microversion: 2.1 time: 0.036407 Aug 29 20:20:52.786514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 409/804] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:20:52 2022] GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:53.582704 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:53.584123 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:53.590964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:53.591655 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:53.592279 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:53.593369 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:53.594144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:53.594850 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:53.789098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:53.805478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2bd25469-c671-42b1-bd88-e4b00e278409 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9c4c8b0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:53.812764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:53.814244 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:53.815404 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-df5577b3-e69f-4dad-99cb-ee10618574b0 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.236715 Aug 29 20:20:53.815971 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 396/805] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:53 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:53.863512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2bd25469-c671-42b1-bd88-e4b00e278409 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 200 len: 286 microversion: 2.1 time: 0.066768 Aug 29 20:20:53.864571 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 410/806] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:20:53 2022] GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:54.840604 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:54.841325 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:54.851391 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:54.852188 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:54.852985 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:54.853977 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:54.854650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:54.855212 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:54.882314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bd9e6efe-fd58-4556-be6f-43aec2e0725e tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9ca74c0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:54.933101 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bd9e6efe-fd58-4556-be6f-43aec2e0725e tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 200 len: 286 microversion: 2.1 time: 0.058398 Aug 29 20:20:54.934200 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 411/807] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:20:54 2022] GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:55.055410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:55.065608 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:55.067121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:55.068819 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a68fc084-4c6f-47a8-ab9e-3307f1ee590a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.232855 Aug 29 20:20:55.069680 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 397/808] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:54 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:55.949349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b16646c1-6cef-4304-a7c5-9dd16570a5ae tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9cd8ee0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:55.983910 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b16646c1-6cef-4304-a7c5-9dd16570a5ae tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 200 len: 287 microversion: 2.1 time: 0.038290 Aug 29 20:20:55.984524 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 412/809] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:20:55 2022] GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:55.997546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7cc6ad45-8753-43e5-a04c-ebe9308354d7 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9dc29d0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:56.074623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7cc6ad45-8753-43e5-a04c-ebe9308354d7 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 202 len: 0 microversion: 2.1 time: 0.080801 Aug 29 20:20:56.079781 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 398/810] 10.222.0.73 () {58 vars in 1254 bytes} [Mon Aug 29 20:20:55 2022] DELETE /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:20:56.089826 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4b0d9f29-7f8e-4ad9-b064-fa07eae97b25 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9bdb040>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:56.100054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:56.100744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:56.113512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:56.115056 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:56.115826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:56.117048 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:56.117887 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:56.118632 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:56.160773 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4b0d9f29-7f8e-4ad9-b064-fa07eae97b25 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 200 len: 286 microversion: 2.1 time: 0.078522 Aug 29 20:20:56.161657 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 413/811] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:20:56 2022] GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:20:56.342263 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:56.353281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:56.354831 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:56.356433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ff4d34f1-594d-43e5-a0cb-3d0f30806907 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.261134 Aug 29 20:20:56.357768 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 399/812] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:56 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:20:57.178216 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9c3f1473-3608-4119-8dc3-875728d01f50 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9c1f040>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:57.214301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-9c3f1473-3608-4119-8dc3-875728d01f50 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] HTTP exception thrown: Snapshot a1c1155c-bb3b-4e14-8918-41ff566814fd could not be found. Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9c3f1473-3608-4119-8dc3-875728d01f50 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Request method failure captured: Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd HTTP/1.1 Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR-hYqyjmL5gM1rYAO6O6yKsPepQlfsXN5irYm4azj3WjZKE4VlBOtJ01Wyzz_mwo49BIRngr1xJymI21PpOhZjUfr4lXXpzC9JaVV3QZuJ3huscXsDdCa4pm2IMWFT_Aj5O2KXj4sTuAKxgsa-F6EaGxxnI2qje6ZElAUrkSFLyHIo Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 09c84765f43545a08c5a45550a46629e Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:20:57.217108 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09c84765f43545a08c5a45550a46629e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09c84765f43545a08c5a45550a46629e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09c84765f43545a08c5a45550a46629e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09c84765f43545a08c5a45550a46629e"}]}] Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 09c84765f43545a08c5a45550a46629e Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesSnapshotsTestJSON-1814851776-project Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: ac972bf1d94243098f5ef845b89ca22d Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814851776-project Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Snapshot a1c1155c-bb3b-4e14-8918-41ff566814fd could not be found. Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'a1c1155c-bb3b-4e14-8918-41ff566814fd'} Aug 29 20:20:57.219467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a1c1155c-bb3b-4e14-8918-41ff566814fd could not be found. (HTTP 404) (Request-ID: req-687f353a-97ca-44c0-82f4-9b545541940d) Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.221032 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:20:57.223242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a1c1155c-bb3b-4e14-8918-41ff566814fd could not be found. Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 20:20:57.225696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a1c1155c-bb3b-4e14-8918-41ff566814fd could not be found. Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a1c1155c-bb3b-4e14-8918-41ff566814fd could not be found. Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9c3f1473-3608-4119-8dc3-875728d01f50 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Returning 404 to user: Snapshot a1c1155c-bb3b-4e14-8918-41ff566814fd could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:57.228278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9c3f1473-3608-4119-8dc3-875728d01f50 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd" status: 404 len: 111 microversion: 2.1 time: 0.053845 Aug 29 20:20:57.230002 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 414/813] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:20:57 2022] GET /compute/v2.1/os-snapshots/a1c1155c-bb3b-4e14-8918-41ff566814fd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:57.235952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-520d4fc1-faef-4fca-99e9-9230c371106c tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9dc2550>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:57.324870 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-520d4fc1-faef-4fca-99e9-9230c371106c tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc" status: 202 len: 0 microversion: 2.1 time: 0.092780 Aug 29 20:20:57.325601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 400/814] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:20:57 2022] DELETE /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:20:57.335274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-429f30ea-d27a-4a02-89ad-a92c313eca3a tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9bdb310>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:57.383550 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:57.384164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:57.397764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:57.398271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:57.398816 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:57.399881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:57.400524 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:57.401265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:57.403647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-429f30ea-d27a-4a02-89ad-a92c313eca3a tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc" status: 200 len: 345 microversion: 2.1 time: 0.073314 Aug 29 20:20:57.404230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 415/815] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:20:57 2022] GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:57.571652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:57.580625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:57.582111 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:57.583449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d78fdbcf-a49e-40d2-9dec-ef368f9fd911 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.204611 Aug 29 20:20:57.584039 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 401/816] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:57 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:58.419774 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a7de5c92-2f0f-49ed-8be2-39572a07e733 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9c30820>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:58.448196 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-a7de5c92-2f0f-49ed-8be2-39572a07e733 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] HTTP exception thrown: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a7de5c92-2f0f-49ed-8be2-39572a07e733 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Request method failure captured: Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc HTTP/1.1 Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR-hYqyjmL5gM1rYAO6O6yKsPepQlfsXN5irYm4azj3WjZKE4VlBOtJ01Wyzz_mwo49BIRngr1xJymI21PpOhZjUfr4lXXpzC9JaVV3QZuJ3huscXsDdCa4pm2IMWFT_Aj5O2KXj4sTuAKxgsa-F6EaGxxnI2qje6ZElAUrkSFLyHIo Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 09c84765f43545a08c5a45550a46629e Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:20:58.450437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09c84765f43545a08c5a45550a46629e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09c84765f43545a08c5a45550a46629e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09c84765f43545a08c5a45550a46629e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09c84765f43545a08c5a45550a46629e"}]}] Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 09c84765f43545a08c5a45550a46629e Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesSnapshotsTestJSON-1814851776-project Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: ac972bf1d94243098f5ef845b89ca22d Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814851776-project Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '891456f6-9e08-4b6f-af71-ba0bf78586fc'} Aug 29 20:20:58.451955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. (HTTP 404) (Request-ID: req-99e1640b-9d0b-49ce-9836-bda93083fa63) Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.452901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:20:58.454301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:20:58.455607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a7de5c92-2f0f-49ed-8be2-39572a07e733 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Returning 404 to user: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a7de5c92-2f0f-49ed-8be2-39572a07e733 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc" status: 404 len: 109 microversion: 2.1 time: 0.036587 Aug 29 20:20:58.457107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 416/817] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:20:58 2022] GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:58.468040 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7200117c-c779-4425-9016-4942132f42f2 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9dc2160>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:58.503403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-7200117c-c779-4425-9016-4942132f42f2 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] HTTP exception thrown: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7200117c-c779-4425-9016-4942132f42f2 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Request method failure captured: Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc HTTP/1.1 Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR-hYqyjmL5gM1rYAO6O6yKsPepQlfsXN5irYm4azj3WjZKE4VlBOtJ01Wyzz_mwo49BIRngr1xJymI21PpOhZjUfr4lXXpzC9JaVV3QZuJ3huscXsDdCa4pm2IMWFT_Aj5O2KXj4sTuAKxgsa-F6EaGxxnI2qje6ZElAUrkSFLyHIo Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 09c84765f43545a08c5a45550a46629e Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:20:58.506543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09c84765f43545a08c5a45550a46629e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09c84765f43545a08c5a45550a46629e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09c84765f43545a08c5a45550a46629e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09c84765f43545a08c5a45550a46629e"}]}] Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 09c84765f43545a08c5a45550a46629e Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesSnapshotsTestJSON-1814851776-project Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: ac972bf1d94243098f5ef845b89ca22d Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814851776-project Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '891456f6-9e08-4b6f-af71-ba0bf78586fc'} Aug 29 20:20:58.507846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. (HTTP 404) (Request-ID: req-c1fe3a60-a759-4795-8400-8f685591a469) Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.508790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:20:58.510809 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:20:58.511917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7200117c-c779-4425-9016-4942132f42f2 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Returning 404 to user: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7200117c-c779-4425-9016-4942132f42f2 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc" status: 404 len: 109 microversion: 2.1 time: 0.044671 Aug 29 20:20:58.514078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 402/818] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:20:58 2022] DELETE /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:58.525440 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-74f7fa63-dcff-4837-b3b1-9c37cb0b2b74 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Calling method '.version_select at 0x7f15f9bdb8b0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:58.577593 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-74f7fa63-dcff-4837-b3b1-9c37cb0b2b74 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] HTTP exception thrown: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-74f7fa63-dcff-4837-b3b1-9c37cb0b2b74 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Request method failure captured: Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc HTTP/1.1 Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR-hYqyjmL5gM1rYAO6O6yKsPepQlfsXN5irYm4azj3WjZKE4VlBOtJ01Wyzz_mwo49BIRngr1xJymI21PpOhZjUfr4lXXpzC9JaVV3QZuJ3huscXsDdCa4pm2IMWFT_Aj5O2KXj4sTuAKxgsa-F6EaGxxnI2qje6ZElAUrkSFLyHIo Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 09c84765f43545a08c5a45550a46629e Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:20:58.579938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09c84765f43545a08c5a45550a46629e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09c84765f43545a08c5a45550a46629e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09c84765f43545a08c5a45550a46629e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09c84765f43545a08c5a45550a46629e"}]}] Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 09c84765f43545a08c5a45550a46629e Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814851776 Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesSnapshotsTestJSON-1814851776-project Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: ac972bf1d94243098f5ef845b89ca22d Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814851776-project Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '891456f6-9e08-4b6f-af71-ba0bf78586fc'} Aug 29 20:20:58.581434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. (HTTP 404) (Request-ID: req-e328a934-0a4f-43c2-8e72-a9397f076431) Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.582311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:20:58.583811 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:20:58.585129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-74f7fa63-dcff-4837-b3b1-9c37cb0b2b74 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] Returning 404 to user: Volume 891456f6-9e08-4b6f-af71-ba0bf78586fc could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-74f7fa63-dcff-4837-b3b1-9c37cb0b2b74 tempest-VolumesSnapshotsTestJSON-1814851776 tempest-VolumesSnapshotsTestJSON-1814851776-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc" status: 404 len: 109 microversion: 2.1 time: 0.064985 Aug 29 20:20:58.590942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 417/819] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:20:58 2022] GET /compute/v2.1/os-volumes/891456f6-9e08-4b6f-af71-ba0bf78586fc => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:58.617533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:58.622947 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:58.642707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:58.643353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:58.643887 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:58.644768 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:58.645339 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:58.646123 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:58.884197 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:58.906616 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:58.908786 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:58.910542 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fa36d1ad-642d-4bae-b439-a6eb5528e1f1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.300804 Aug 29 20:20:58.930257 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 403/820] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:58 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:59.951060 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:59.954306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:59.957193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:59.968425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:59.968808 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:59.969415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:59.970119 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:59.970592 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:59.978760 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:00.176107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:00.189223 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:00.191727 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:00.193884 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c300a2a0-ef18-4a69-9a30-720ab0bbdbe4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.260518 Aug 29 20:21:00.195049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 418/821] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:20:59 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:21:00.977142 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:00.977982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:00.984743 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:00.985225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:00.985652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:00.986402 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:00.986852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:00.987269 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:01.020041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:21:01.159461 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e70aee81-5955-4d3a-b1ec-eb071293da10 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 204 len: 0 microversion: 2.1 time: 0.185807 Aug 29 20:21:01.160498 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 404/822] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:21:00 2022] DELETE /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:21:01.171610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:01.172248 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:01.182469 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:01.183084 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:01.183595 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:01.184395 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:01.184909 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:01.185418 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:01.220041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:01.221048 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:01.228746 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:01.229546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:01.230181 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:01.231105 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:01.231958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:01.232981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:01.347536 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:01.357512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-65d8eb4f-7141-47a4-9bc3-6a4630b35ac6 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1577 microversion: 2.1 time: 0.190101 Aug 29 20:21:01.358082 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 419/823] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:01 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:01.398470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:01.407596 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:01.409035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:01.410292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c2f58461-4c03-4aae-9864-c667b96aba57 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.195930 Aug 29 20:21:01.410899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 405/824] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:01 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:21:02.383399 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:02.384342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:02.392775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:02.393317 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:02.393883 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:02.394729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:02.395182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:02.396009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:02.436163 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:02.436816 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:02.444779 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:02.445270 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:02.445744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:02.446433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:02.446878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:02.447299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:02.571207 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:02.582425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-51c81c03-2978-44de-9c22-495812681096 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1577 microversion: 2.1 time: 0.206362 Aug 29 20:21:02.583996 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 420/825] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:02 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:02.617669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:02.627443 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:02.628867 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:02.630164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a25ec88d-07e6-4d79-b113-17790fc1d076 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.198037 Aug 29 20:21:02.630808 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 406/826] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:02 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:21:03.619237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:03.619895 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:03.626610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:03.627088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:03.627516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:03.628296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:03.628750 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:03.629169 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:03.654080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:03.654908 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:03.661778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:03.662375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:03.662807 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:03.663498 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:03.663946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:03.664358 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:03.804662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:03.820159 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-19a75b7b-a90b-46da-9486-1e00cf204530 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1577 microversion: 2.1 time: 0.206310 Aug 29 20:21:03.822072 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 421/827] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:03 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:03.856364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:03.868082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:03.870500 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:03.872354 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e0c121e4-4d4b-437a-8961-b796520142a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.221993 Aug 29 20:21:03.873180 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 407/828] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:03 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:21:04.855753 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:04.857278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:04.864125 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:04.865418 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:04.866089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:04.866823 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:04.867272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:04.867687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:04.904881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:04.906167 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:04.940798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:04.946169 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:04.958461 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:04.959640 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:04.960229 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:04.960731 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:04.994220 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:05.006223 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6f08d4ed-d987-45cd-8f0a-1450a9046723 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1509 microversion: 2.1 time: 0.157289 Aug 29 20:21:05.006807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 422/829] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:04 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:05.034396 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-bc7ebf7e-aa51-4632-a5a5-df4b967dd021 req-b76b8aea-6f18-478f-93bb-10370a252d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9785564a-cd3d-4595-8af9-dbb8f45a4920", "name": "network-vif-deleted", "tag": "a5f16ea7-0d10-4de8-b264-64fb2d5c7d6f"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:05.053088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-bc7ebf7e-aa51-4632-a5a5-df4b967dd021 req-b76b8aea-6f18-478f-93bb-10370a252d18 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:05.054264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-bc7ebf7e-aa51-4632-a5a5-df4b967dd021 req-b76b8aea-6f18-478f-93bb-10370a252d18 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:05.054954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-bc7ebf7e-aa51-4632-a5a5-df4b967dd021 req-b76b8aea-6f18-478f-93bb-10370a252d18 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:05.072397 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-bc7ebf7e-aa51-4632-a5a5-df4b967dd021 req-b76b8aea-6f18-478f-93bb-10370a252d18 service nova] Creating event network-vif-deleted:a5f16ea7-0d10-4de8-b264-64fb2d5c7d6f for instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 on hv-cinder-85426 Aug 29 20:21:05.090090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-bc7ebf7e-aa51-4632-a5a5-df4b967dd021 req-b76b8aea-6f18-478f-93bb-10370a252d18 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062549 Aug 29 20:21:05.092413 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 423/830] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:05.158119 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:05.169603 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:05.171885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:05.173236 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c3971991-4991-43d6-b3bf-39196e7b70a2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.275446 Aug 29 20:21:05.186218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 408/831] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:04 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:21:05.517010 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-ad28d7dd-299d-45f1-84dc-88d618a63727 req-89133604-8d1c-4e04-8a2e-bfe0a8c480e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4563b2-c0de-4300-be32-5faa8f8476d8", "name": "network-vif-plugged", "status": "completed", "tag": "1ab12c9b-86bb-41bd-aab2-ca30f835e85d"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:05.535912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ad28d7dd-299d-45f1-84dc-88d618a63727 req-89133604-8d1c-4e04-8a2e-bfe0a8c480e2 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:05.537103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ad28d7dd-299d-45f1-84dc-88d618a63727 req-89133604-8d1c-4e04-8a2e-bfe0a8c480e2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:05.538194 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ad28d7dd-299d-45f1-84dc-88d618a63727 req-89133604-8d1c-4e04-8a2e-bfe0a8c480e2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:05.562433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-ad28d7dd-299d-45f1-84dc-88d618a63727 req-89133604-8d1c-4e04-8a2e-bfe0a8c480e2 service nova] Creating event network-vif-plugged:1ab12c9b-86bb-41bd-aab2-ca30f835e85d for instance eb4563b2-c0de-4300-be32-5faa8f8476d8 on hv-cinder-85426 Aug 29 20:21:05.571745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-ad28d7dd-299d-45f1-84dc-88d618a63727 req-89133604-8d1c-4e04-8a2e-bfe0a8c480e2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063363 Aug 29 20:21:05.573013 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 424/832] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:06.035470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:06.035470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:06.041881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:06.042424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:06.043047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:06.044200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:06.044695 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:06.045124 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:06.093455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:06.093455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:06.093923 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:06.094381 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lazy-loading 'fault' on Instance uuid 9785564a-cd3d-4595-8af9-dbb8f45a4920 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:21:06.144546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:06.154759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aefc4072-d7cf-46fa-9923-021e96708f4e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 200 len: 1229 microversion: 2.1 time: 0.125649 Aug 29 20:21:06.156121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 409/833] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:06 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 1229 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:06.199114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:06.200768 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:06.212666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:06.213731 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:06.214516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:06.215676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:06.216295 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:06.216955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:06.447693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:06.460369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:06.463089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:06.466235 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f2268ab1-9b37-4673-b462-4cdc9bfaceb4 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.271296 Aug 29 20:21:06.467510 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 425/834] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:06 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:21:07.181170 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:07.181975 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:07.189306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:07.189824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:07.190262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:07.190958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:07.191412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:07.191838 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:07.209478 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] HTTP exception thrown: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Request method failure captured: Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 HTTP/1.1 Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR71Fgj3TxYsyVzo2rqmkdlvt4iWnL5bfjcc0CFwuUIuDIDi04i8paFgZdOehgFnT33kxR3CDrn9DN52AxfMhZmF8nbwa-NxgPF4yZHXlB0BAER5JT3aPRXTbCuKy2NdJuBhu2bvdYlnjTgPq5jRFajcELOMSHC2yILZVGYgiDwXifk Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:21:07.211438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}] Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 8640600ca0d745cda547a1027c947089 Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:21:07.213054 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '9785564a-cd3d-4595-8af9-dbb8f45a4920'} Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:21:07.214059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:21:07.215333 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:07.216448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Returning 404 to user: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:21:07.216448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c136acb2-4c79-441d-87ac-7ed3b1d52653 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 404 len: 111 microversion: 2.1 time: 0.036302 Aug 29 20:21:07.216448 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 410/835] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:07 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:21:07.347782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1627572066", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-220491953", "security_groups": [{"name": "tempest-secgroup-smoke-1427790051"}], "block_device_mapping_v2": [{"uuid": "91202c6e-d020-4f8f-8973-73bb792c2045", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d909eff5-27cf-4d36-886a-2daf13a96ae0"}]}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:07.481696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] validate_networks() for [('d909eff5-27cf-4d36-886a-2daf13a96ae0', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:21:07.502671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:07.503193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:07.510326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:07.510820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:07.511252 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:07.512999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:07.512999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:07.512999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:07.703950 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:07.718472 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:07.720804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:07.722969 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1076bbe8-3e13-406f-9d3e-a8db1b9b917c tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.224470 Aug 29 20:21:07.725277 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 411/836] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:07 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:21:08.228601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:21:08.229045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:21:08.229627 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:21:08.230203 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:21:08.230494 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:21:08.241094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:08.241579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:08.242045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:08.242805 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:08.243215 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:08.243641 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:08.262297 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Getting quotas for project ff3969ffe8ff411b8773e1f3f3cb0b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:08.267229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Getting quotas for user 8640600ca0d745cda547a1027c947089 and project ff3969ffe8ff411b8773e1f3f3cb0b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:08.338657 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:21:08.340832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91202c6e-d020-4f8f-8973-73bb792c2045',volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:21:08.485369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ee18e0d2-6ade-468a-8e5b-cb416e579846 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.141743 Aug 29 20:21:08.486191 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 426/837] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:21:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:21:08.498366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b3be6e94-a7b9-44a3-948a-a72cdcf4390b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:08.498963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b3be6e94-a7b9-44a3-948a-a72cdcf4390b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:08.557485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b3be6e94-a7b9-44a3-948a-a72cdcf4390b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:08.564979 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b3be6e94-a7b9-44a3-948a-a72cdcf4390b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1094 microversion: 2.1 time: 0.070779 Aug 29 20:21:08.566368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 412/838] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:08 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:08.757324 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:08.758466 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:08.766168 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:08.766673 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:08.767113 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:08.767861 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:08.768865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:08.769307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:08.967425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:08.976621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:08.980791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:08.984018 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:08.986426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c3ea4bad-b2fc-45c0-864c-e4f1581a7173 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1731 microversion: 2.20 time: 0.232842 Aug 29 20:21:09.003381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 427/839] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:08 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:21:09.587928 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:09.588524 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:09.595872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:09.596384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:09.596876 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:09.597585 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:09.598077 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:09.598506 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:09.672445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:09.682149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b99323ac-ec14-4cc4-9b65-2aeefa6a64a7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1192 microversion: 2.1 time: 0.098697 Aug 29 20:21:09.682726 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 413/840] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:09 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:10.011373 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:10.011955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:10.019296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:10.019793 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:10.020231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:10.021555 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:10.022053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:10.022485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:10.196513 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:10.205358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:10.206923 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:10.209290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a9970e4a-4f77-4d54-80fc-81b7b66d07a1 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1718 microversion: 2.20 time: 0.200993 Aug 29 20:21:10.210143 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 428/841] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:10 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1718 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:21:10.703843 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:10.705208 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:10.712599 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:10.713089 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:10.713613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:10.714405 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:10.715024 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:10.715640 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:11.082205 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:11.085989 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:11.091783 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3e7a7463-e8fe-467c-874b-a4bfe94e90c1 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1278 microversion: 2.1 time: 0.391968 Aug 29 20:21:11.092612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 414/842] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:10 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1278 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:11.773293 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-ba990992-d54f-42b3-85de-31e04162e433 req-d4c10d53-e4c2-4374-9ec1-fb866e3325dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc668fb0-2df9-4f20-b2eb-edb014a2eb1c", "tag": "2fe84f3d-7bc6-4d1c-a981-074dce1683fd"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:11.787639 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ba990992-d54f-42b3-85de-31e04162e433 req-d4c10d53-e4c2-4374-9ec1-fb866e3325dd service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:11.788284 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ba990992-d54f-42b3-85de-31e04162e433 req-d4c10d53-e4c2-4374-9ec1-fb866e3325dd service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:11.788936 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-ba990992-d54f-42b3-85de-31e04162e433 req-d4c10d53-e4c2-4374-9ec1-fb866e3325dd service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:11.804096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-ba990992-d54f-42b3-85de-31e04162e433 req-d4c10d53-e4c2-4374-9ec1-fb866e3325dd service nova] Creating event network-changed:2fe84f3d-7bc6-4d1c-a981-074dce1683fd for instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c on hv-cinder-85426 Aug 29 20:21:11.812983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-ba990992-d54f-42b3-85de-31e04162e433 req-d4c10d53-e4c2-4374-9ec1-fb866e3325dd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044318 Aug 29 20:21:11.815231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 429/843] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:12.122076 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:12.122669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:12.124955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:12.132953 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:12.133398 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:12.133861 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:12.134553 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:12.134997 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:12.135409 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:12.394129 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:12.403061 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0853b592-3856-4b4f-baac-76a5cd00caf8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.285018 Aug 29 20:21:12.418318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 415/844] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:12 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:13.428831 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:13.429824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:13.435783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:13.436268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:13.436703 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:13.437600 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:13.438085 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:13.438511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:13.610528 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:13.620167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ade972be-e691-4271-b6dd-feee77c5a3b0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.196513 Aug 29 20:21:13.620856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 430/845] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:13 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:14.649031 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:14.649615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:14.656315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:14.656787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:14.657211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:14.657930 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:14.658384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:14.658804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:14.801724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:14.811187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f31156a8-4b0e-4cce-9bb2-100b490d377e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.166600 Aug 29 20:21:14.811758 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 416/846] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:14 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:15.832812 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:15.833931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:15.840719 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:15.841192 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:15.841633 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:15.842326 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:15.842770 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:15.843186 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:15.986269 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:15.994617 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-47f3c395-57d1-4386-a4ef-60dd2767107d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.165644 Aug 29 20:21:15.995187 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 431/847] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:15 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:17.019322 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:17.020015 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:17.028006 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:17.028480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:17.029087 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:17.029665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:17.030142 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:17.030558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:17.176346 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:17.185002 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fb8211ba-b2cc-4e47-a386-f18f0bf6adda tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.171529 Aug 29 20:21:17.185570 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 417/848] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:17 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:18.208184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:18.209022 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:18.217924 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:18.218871 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:18.219620 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:18.220771 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:18.221509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:18.222342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:18.257508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:18.274249 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=6 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:18.414044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:18.422794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-23c8e2b3-3a3c-41d5-ac95-78c085c69820 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.220288 Aug 29 20:21:18.423468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 432/849] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:18 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:19.449514 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:19.450276 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:19.454162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:19.458571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:19.459090 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:19.459572 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:19.460335 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:19.460949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:19.461382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:19.684724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:19.700895 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-06ee597c-f108-4644-88c3-0a0f4b4844e5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.255736 Aug 29 20:21:19.701764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 418/850] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:19 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:20.728823 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:20.730165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:20.739778 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:20.740334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:20.740970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:20.741976 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:20.742532 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:20.743281 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:21.110920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:21.124820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-028cce88-ebde-4f2f-ac17-da0daf8cedc8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.400428 Aug 29 20:21:21.125767 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 433/851] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:20 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:21.603863 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-6751f019-3b89-4209-8030-7f46b1bffb83 req-6dc6f897-067d-4eb5-a277-e10b041295b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc668fb0-2df9-4f20-b2eb-edb014a2eb1c", "name": "network-vif-plugged", "status": "completed", "tag": "2fe84f3d-7bc6-4d1c-a981-074dce1683fd"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:21.619790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6751f019-3b89-4209-8030-7f46b1bffb83 req-6dc6f897-067d-4eb5-a277-e10b041295b7 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:21.620426 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6751f019-3b89-4209-8030-7f46b1bffb83 req-6dc6f897-067d-4eb5-a277-e10b041295b7 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:21.620722 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6751f019-3b89-4209-8030-7f46b1bffb83 req-6dc6f897-067d-4eb5-a277-e10b041295b7 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:21.634327 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-6751f019-3b89-4209-8030-7f46b1bffb83 req-6dc6f897-067d-4eb5-a277-e10b041295b7 service nova] Creating event network-vif-plugged:2fe84f3d-7bc6-4d1c-a981-074dce1683fd for instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c on hv-cinder-85426 Aug 29 20:21:21.639898 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-6751f019-3b89-4209-8030-7f46b1bffb83 req-6dc6f897-067d-4eb5-a277-e10b041295b7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040796 Aug 29 20:21:21.641135 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 419/852] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:22.155551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:22.155551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:22.163322 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.163928 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.164367 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.165080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.165538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.166218 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.190406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:22.191387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:22.201962 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.203401 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.204829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.207159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.208538 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.210121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.254403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-29272c9b-4062-44e2-8e49-d8e7f15bde51 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d/ips" status: 200 len: 150 microversion: 2.1 time: 0.069133 Aug 29 20:21:22.256103 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 420/853] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:21:22 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d/ips => generated 150 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:21:22.270549 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3eb3041b-2900-4252-be66-9aa23e45055a"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:22.273820 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:22.284923 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.286159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.287616 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.289268 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.290206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.291271 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.402649 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:22.413613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d6f00cfd-6317-434c-876e-0f4a5cbbc9df tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.262090 Aug 29 20:21:22.414761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 434/854] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:22 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:22.440453 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Invalid volume: volume 3eb3041b-2900-4252-be66-9aa23e45055a is already attached to instances: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: POST /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d/os-volume_attachments HTTP/1.1 Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 74 Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:21:22.442852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {"volumeAttachment": {"volumeId": "3eb3041b-2900-4252-be66-9aa23e45055a"}} Aug 29 20:21:22.445239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Invalid volume: volume 3eb3041b-2900-4252-be66-9aa23e45055a is already attached to instances: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'server_id': 'f30c5f72-8898-482c-85c6-2556a5d7df9d', 'body': {'volumeAttachment': {'volumeId': '3eb3041b-2900-4252-be66-9aa23e45055a'}}} Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3eb3041b-2900-4252-be66-9aa23e45055a is already attached to instances: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:22.446470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3eb3041b-2900-4252-be66-9aa23e45055a is already attached to instances: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:22.448372 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:22.455387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:22.455387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:21:22.455387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:21:22.455387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3eb3041b-2900-4252-be66-9aa23e45055a is already attached to instances: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 Aug 29 20:21:22.455387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:22.455387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 400 to user: Invalid volume: volume 3eb3041b-2900-4252-be66-9aa23e45055a is already attached to instances: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:21:22.455387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d377972f-f595-4b07-ace6-c32071316509 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.182794 Aug 29 20:21:22.455387 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 421/855] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:21:22 2022] POST /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d/os-volume_attachments => generated 174 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:21:22.462826 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:22.463660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:22.470352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.470834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.471256 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.472178 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.472774 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.475245 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.505802 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:21:22.621697 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-102314d4-4f15-40dd-acdb-3cf9f063367b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 204 len: 0 microversion: 2.1 time: 0.163926 Aug 29 20:21:22.622897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 435/856] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:21:22 2022] DELETE /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:21:22.633601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:22.633601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:22.647756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.648633 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.649281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.650050 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.650513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.650948 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.848929 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:22.859873 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1bc14859-6289-40b5-b8d5-7bd31bbb5d54 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1680 microversion: 2.1 time: 0.231557 Aug 29 20:21:22.860478 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 422/857] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:22 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:23.445229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:23.446237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:23.456398 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.457149 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.457824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:23.459508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.460182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.460834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:23.667727 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:23.679175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c84e3a82-dcbc-49e3-85d8-c29c1d2c356e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.242913 Aug 29 20:21:23.679761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 436/858] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:23 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:23.884599 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:23.885238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:23.894475 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.895180 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.895627 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:23.896599 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.897057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.897559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:24.096623 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:24.109153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2f69719a-5c71-434e-b2ae-f7ec801085b2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1680 microversion: 2.1 time: 0.229558 Aug 29 20:21:24.109757 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 423/859] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:23 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:24.701453 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:24.702382 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:24.710668 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:24.711243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:24.711675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:24.712383 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:24.713122 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:24.713546 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:24.926427 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:24.939757 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bbadb208-50bd-4345-899e-eaf2ca75de77 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1266 microversion: 2.1 time: 0.242394 Aug 29 20:21:24.940721 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 437/860] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:24 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:25.135143 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:25.136297 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:25.147684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:25.148427 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:25.148969 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:25.150112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:25.150868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:25.151614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:25.333781 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:25.343489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3240a0e5-2795-48f5-ad13-7738dc4ef460 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1680 microversion: 2.1 time: 0.215023 Aug 29 20:21:25.344068 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 424/861] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:25 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1680 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:25.975885 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:25.976993 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:25.995376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:25.996541 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:25.996980 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:25.997687 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:25.998163 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:25.998590 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:26.216076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:26.230373 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-708718f3-079c-44e2-bd4e-d81c5503ce41 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1453 microversion: 2.1 time: 0.262726 Aug 29 20:21:26.231309 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 438/862] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:25 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1453 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:26.258891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:26.260464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:26.273733 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:26.274621 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:26.275235 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:26.275946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:26.276394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:26.276831 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:26.371739 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:26.373233 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:26.387182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:26.387958 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:26.388636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:26.389857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:26.390597 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:26.391303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:26.603091 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:26.604190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:26.618135 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6ce86b7e-6bf8-4a6b-ba7b-971fa017399e tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1453 microversion: 2.1 time: 0.368333 Aug 29 20:21:26.619481 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 425/863] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:26 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1453 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:26.620026 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b3c9d189-a35f-4819-83d5-fd239646c431 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1680 microversion: 2.1 time: 0.257612 Aug 29 20:21:26.620826 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 439/864] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:26 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:27.241593 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-fb56f638-09df-4138-a42f-db56ab954d02 req-066f3fc1-d79f-4a32-a77a-fd1645576dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30c5f72-8898-482c-85c6-2556a5d7df9d", "name": "network-vif-deleted", "tag": "b4e00c26-8522-48f6-9ab5-604edc4776b4"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:27.262412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fb56f638-09df-4138-a42f-db56ab954d02 req-066f3fc1-d79f-4a32-a77a-fd1645576dd1 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.264704 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fb56f638-09df-4138-a42f-db56ab954d02 req-066f3fc1-d79f-4a32-a77a-fd1645576dd1 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.265421 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fb56f638-09df-4138-a42f-db56ab954d02 req-066f3fc1-d79f-4a32-a77a-fd1645576dd1 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.283811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-fb56f638-09df-4138-a42f-db56ab954d02 req-066f3fc1-d79f-4a32-a77a-fd1645576dd1 service nova] Creating event network-vif-deleted:b4e00c26-8522-48f6-9ab5-604edc4776b4 for instance f30c5f72-8898-482c-85c6-2556a5d7df9d on hv-cinder-85426 Aug 29 20:21:27.322042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-fb56f638-09df-4138-a42f-db56ab954d02 req-066f3fc1-d79f-4a32-a77a-fd1645576dd1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083012 Aug 29 20:21:27.323033 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 426/865] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:27.648463 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:27.649861 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:27.657090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.657863 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.658799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.660095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.660558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.661291 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.700919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.701690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.702296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.702939 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lazy-loading 'fault' on Instance uuid f30c5f72-8898-482c-85c6-2556a5d7df9d {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:21:27.772375 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:27.794491 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-81d6c6fd-67f1-4e73-bc01-dba453a36707 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 200 len: 1331 microversion: 2.1 time: 0.148100 Aug 29 20:21:27.805865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 440/866] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:27 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:28.830466 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:28.832035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:28.850004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:28.852093 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:28.853121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:28.855422 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:28.857270 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:28.858599 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:28.893824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d HTTP/1.1 Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:21:28.900697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:21:28.904296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'f30c5f72-8898-482c-85c6-2556a5d7df9d'} Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:21:28.906004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:21:28.908588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:28.913496 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:21:28.913496 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5c177ab0-d8fc-4f96-8daf-2ba70f605a8c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 404 len: 111 microversion: 2.1 time: 0.081945 Aug 29 20:21:28.913496 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 427/867] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:28 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:21:28.918074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2e93fb70-e625-49f9-8ae3-17c00a495d32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '.version_select at 0x7f15f9cd8f70>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:28.960453 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2e93fb70-e625-49f9-8ae3-17c00a495d32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333429671" status: 202 len: 0 microversion: 2.1 time: 0.049513 Aug 29 20:21:28.961574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 441/868] 10.222.0.73 () {58 vars in 1221 bytes} [Mon Aug 29 20:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333429671 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:21:29.339378 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-fc76adb2-5c62-4cfc-93ed-ec4674533fc6 req-98d2e61e-39be-4782-9307-9f9414e4d696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc668fb0-2df9-4f20-b2eb-edb014a2eb1c", "tag": "2fe84f3d-7bc6-4d1c-a981-074dce1683fd"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:29.371242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fc76adb2-5c62-4cfc-93ed-ec4674533fc6 req-98d2e61e-39be-4782-9307-9f9414e4d696 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:29.384084 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fc76adb2-5c62-4cfc-93ed-ec4674533fc6 req-98d2e61e-39be-4782-9307-9f9414e4d696 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:29.386286 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fc76adb2-5c62-4cfc-93ed-ec4674533fc6 req-98d2e61e-39be-4782-9307-9f9414e4d696 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:29.408258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-fc76adb2-5c62-4cfc-93ed-ec4674533fc6 req-98d2e61e-39be-4782-9307-9f9414e4d696 service nova] Creating event network-changed:2fe84f3d-7bc6-4d1c-a981-074dce1683fd for instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c on hv-cinder-85426 Aug 29 20:21:29.414965 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-fc76adb2-5c62-4cfc-93ed-ec4674533fc6 req-98d2e61e-39be-4782-9307-9f9414e4d696 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086174 Aug 29 20:21:29.415675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 428/869] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:30.550225 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:30.551517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:30.554400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:30.561883 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:30.563502 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:30.564393 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:30.565998 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:30.566791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:30.569325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:30.740998 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lazy-loading 'services' on Instance uuid 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:21:30.897094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c827bd9a-4166-46d5-b0bb-67cb41082bb2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments/3eb3041b-2900-4252-be66-9aa23e45055a" status: 202 len: 0 microversion: 2.1 time: 0.352965 Aug 29 20:21:30.898804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 442/870] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:21:30 2022] DELETE /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments/3eb3041b-2900-4252-be66-9aa23e45055a => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:21:30.916967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:30.931745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:30.945072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:30.946276 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:30.947095 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:30.948106 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:30.948593 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:30.949006 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:30.993933 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ac27a5a8-3beb-43e5-87b1-09b7a6d61d63 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087521 Aug 29 20:21:30.994586 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 429/871] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:21:30 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:32.016671 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:32.021111 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:32.034075 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:32.035887 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:32.037243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:32.039855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:32.041279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:32.042432 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:32.071259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:32.116153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6a38f8cd-af9d-4fbc-a956-769075ef29a2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111775 Aug 29 20:21:32.118097 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 443/872] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:21:32 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:21:33.134918 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:33.138002 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:33.146886 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.147709 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.148432 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.149265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.149798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.150466 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.210233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-44ed76eb-6932-499a-998c-e92c35357ed4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080497 Aug 29 20:21:33.211223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 430/873] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:21:33 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:21:33.301237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:33.302368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:33.309962 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.310739 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.311296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.313055 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.313516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.313990 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.357246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:21:33.470899 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a9aceb4b-3ab4-4c7e-a68f-f7acd06b9b2c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 204 len: 0 microversion: 2.1 time: 0.171015 Aug 29 20:21:33.480303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 444/874] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:21:33 2022] DELETE /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:21:33.487840 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:33.489032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:33.499106 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.499106 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.499716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.500900 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.501619 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.502702 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.591243 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:33.592005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:33.598536 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.599019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.600911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.600911 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.601225 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.602226 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.653836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:21:33.791407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ab0158db-20f7-4de0-8942-1e433f84c5e9 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 204 len: 0 microversion: 2.1 time: 0.204766 Aug 29 20:21:33.793483 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 445/875] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:21:33 2022] DELETE /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:21:33.800537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-647dc4d9-c9eb-40ef-bcaa-c85c576db4a4 req-8e6c5bf2-04cd-462b-a973-e92204cf8f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9470292c-17d1-47bf-9ea3-c5b0eb069a12", "tag": "e83470af-1797-4000-830e-cdec3cee207b"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:33.814730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-647dc4d9-c9eb-40ef-bcaa-c85c576db4a4 req-8e6c5bf2-04cd-462b-a973-e92204cf8f1f service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.815520 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:33.815974 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-647dc4d9-c9eb-40ef-bcaa-c85c576db4a4 req-8e6c5bf2-04cd-462b-a973-e92204cf8f1f service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.816840 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-647dc4d9-c9eb-40ef-bcaa-c85c576db4a4 req-8e6c5bf2-04cd-462b-a973-e92204cf8f1f service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.837352 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aa2adcb6-03dd-4e76-8443-12ddc2cf9b55 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1681 microversion: 2.1 time: 0.354417 Aug 29 20:21:33.838006 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-647dc4d9-c9eb-40ef-bcaa-c85c576db4a4 req-8e6c5bf2-04cd-462b-a973-e92204cf8f1f service nova] Creating event network-changed:e83470af-1797-4000-830e-cdec3cee207b for instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 on hv-cinder-85426 Aug 29 20:21:33.849920 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 431/876] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:33 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1681 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:33.870199 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-647dc4d9-c9eb-40ef-bcaa-c85c576db4a4 req-8e6c5bf2-04cd-462b-a973-e92204cf8f1f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074359 Aug 29 20:21:33.871710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 446/877] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:33.875170 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:33.876046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:33.889144 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.890559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.891312 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.893930 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.894753 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.895516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:34.135369 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:34.152909 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-55670855-3881-4b33-8f10-adfaa5702271 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.313057 Aug 29 20:21:34.154263 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 432/878] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:33 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:34.877056 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:34.878092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:34.885879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:34.886539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:34.887171 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:34.888114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:34.888753 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:34.889070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:35.069804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:35.078783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b94bfa47-3139-4609-b4ab-39bd72995bb4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1681 microversion: 2.1 time: 0.213317 Aug 29 20:21:35.079750 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 447/879] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:34 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:35.178901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:35.179906 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:35.188449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:35.189288 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:35.190010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:35.190980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:35.191528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:35.192091 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:35.371020 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:35.380769 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-384a4b9b-461f-4a81-8b5d-6161403fd028 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.207388 Aug 29 20:21:35.381615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 433/880] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:35 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:36.105098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:36.106222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:36.118268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:36.118833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:36.119300 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:36.120054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:36.120914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:36.121052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:36.305386 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:36.323427 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-36a37200-76dd-4405-86ad-6120ecbe3ab9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1681 microversion: 2.1 time: 0.223996 Aug 29 20:21:36.324525 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 448/881] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:36 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:36.412795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:36.413937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:36.422080 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:36.422766 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:36.423600 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:36.424807 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:36.425561 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:36.426536 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:36.451968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:36.615371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:36.626776 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-19d8c7e5-051f-47d8-a832-f62f4ba8d957 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.218475 Aug 29 20:21:36.627762 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 434/882] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:36 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:37.347769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:37.347769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:37.360880 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:37.361970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:37.362813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:37.364390 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:37.365452 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:37.366206 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:37.653928 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:37.655037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:37.669533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:37.670795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:37.671517 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:37.672746 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:37.673832 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:37.674569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:37.944599 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:37.962493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-8da262bd-1b1c-44e2-9515-01c7d8715c0b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1681 microversion: 2.1 time: 0.619443 Aug 29 20:21:37.963137 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 449/883] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:37 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1681 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:38.033606 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:38.047996 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-64b0cd2d-9d4e-46cd-a31f-0330e45dc4d7 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.399384 Aug 29 20:21:38.049545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 435/884] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:37 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:39.005689 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:39.007388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:39.022348 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:39.023015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:39.024088 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:39.026255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:39.027091 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:39.028370 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:39.083394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:39.085150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:39.098665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:39.099364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:39.100166 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:39.101817 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:39.103113 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:39.104052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:39.401326 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:39.417894 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-df48f0c3-af52-4f36-a1d0-52491e7c701e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1681 microversion: 2.1 time: 0.425574 Aug 29 20:21:39.419889 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 450/885] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:38 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1681 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:39.759786 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:39.784855 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1a0f223a-ecc5-4f6f-bd50-3a700b25b54c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1569 microversion: 2.1 time: 0.710085 Aug 29 20:21:39.785767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 436/886] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:39 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1569 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:40.003329 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-c126671a-a6a4-4a4a-b0aa-90f9143ed36a req-c23f4e06-1d59-4ac5-ac20-2619a8cddbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9470292c-17d1-47bf-9ea3-c5b0eb069a12", "name": "network-vif-deleted", "tag": "e83470af-1797-4000-830e-cdec3cee207b"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:40.017937 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c126671a-a6a4-4a4a-b0aa-90f9143ed36a req-c23f4e06-1d59-4ac5-ac20-2619a8cddbd3 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:40.019894 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c126671a-a6a4-4a4a-b0aa-90f9143ed36a req-c23f4e06-1d59-4ac5-ac20-2619a8cddbd3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:40.020799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c126671a-a6a4-4a4a-b0aa-90f9143ed36a req-c23f4e06-1d59-4ac5-ac20-2619a8cddbd3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:40.040710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-c126671a-a6a4-4a4a-b0aa-90f9143ed36a req-c23f4e06-1d59-4ac5-ac20-2619a8cddbd3 service nova] Creating event network-vif-deleted:e83470af-1797-4000-830e-cdec3cee207b for instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 on hv-cinder-85426 Aug 29 20:21:40.049381 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-c126671a-a6a4-4a4a-b0aa-90f9143ed36a req-c23f4e06-1d59-4ac5-ac20-2619a8cddbd3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050294 Aug 29 20:21:40.051123 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 451/887] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:40.152956 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-3b436983-7178-418a-900b-72f32987e90e req-d53a6079-1281-4ed3-87d7-a173a420d410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa729ec-2c90-4d71-ab0a-23d73b1dd267", "name": "network-vif-deleted", "tag": "211f234f-335d-4a0f-b293-03495489357e"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:40.171649 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3b436983-7178-418a-900b-72f32987e90e req-d53a6079-1281-4ed3-87d7-a173a420d410 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:40.172241 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3b436983-7178-418a-900b-72f32987e90e req-d53a6079-1281-4ed3-87d7-a173a420d410 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:40.173613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3b436983-7178-418a-900b-72f32987e90e req-d53a6079-1281-4ed3-87d7-a173a420d410 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:40.191216 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-3b436983-7178-418a-900b-72f32987e90e req-d53a6079-1281-4ed3-87d7-a173a420d410 service nova] Creating event network-vif-deleted:211f234f-335d-4a0f-b293-03495489357e for instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 on hv-cinder-85426 Aug 29 20:21:40.206292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-3b436983-7178-418a-900b-72f32987e90e req-d53a6079-1281-4ed3-87d7-a173a420d410 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056045 Aug 29 20:21:40.208461 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 437/888] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:21:40.452783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:40.456079 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:40.467321 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:40.468222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:40.468666 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:40.469624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:40.470226 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:40.482601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:40.589265 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:40.602628 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-89b82e7c-3283-44ad-a329-4bc6ff0e7fe7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1326 microversion: 2.1 time: 0.157446 Aug 29 20:21:40.604076 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 452/889] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:40 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:40.824406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:40.826476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:40.837365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:40.838584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:40.839570 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:40.843097 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:40.844185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:40.844896 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:40.934493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:40.943074 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8fce9967-4526-4eb7-a480-90329eef5b9c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1219 microversion: 2.1 time: 0.126774 Aug 29 20:21:40.948685 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 438/890] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:40 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:41.641234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:41.642153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:41.653863 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:41.654351 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:41.654781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:41.655477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:41.655921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:41.656515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:41.705240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:41.705851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:41.706587 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:41.707054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lazy-loading 'fault' on Instance uuid 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:21:41.772317 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:41.789482 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e1390739-4d44-4c95-8a1b-4f5406fa57c2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1331 microversion: 2.1 time: 0.154775 Aug 29 20:21:41.790432 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 453/891] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:41 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1331 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:41.982219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:41.983104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:41.993159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:41.993905 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:41.994798 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:41.996067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:41.996877 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:41.997626 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:42.040241 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:42.040730 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:42.041166 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:42.041615 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lazy-loading 'fault' on Instance uuid 9470292c-17d1-47bf-9ea3-c5b0eb069a12 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:21:42.103664 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c47e7154fd41a7adb4735a519f1484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b4b754e82445a0b65e88f5dbede11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:42.114749 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2cf1ecbe-377e-468d-9e81-c01e7155ac48 tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 200 len: 1224 microversion: 2.1 time: 0.137240 Aug 29 20:21:42.116270 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 439/892] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:41 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 1224 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:42.824388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:42.825157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:42.845550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:42.846070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:42.846512 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:42.847239 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:42.847695 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:42.848296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:42.890148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:42.890562 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:42.891005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:42.891498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lazy-loading 'fault' on Instance uuid 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:21:42.947362 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:42.962380 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6c70ee4d-3f83-4653-99dd-b75ad5553bad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 200 len: 1331 microversion: 2.1 time: 0.142563 Aug 29 20:21:42.963275 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 454/893] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:42 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:43.145364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:43.147237 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] [instance: 9470292c-17d1-47bf-9ea3-c5b0eb069a12] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:43.152433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=52 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:43.156862 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:43.157388 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:43.157992 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:43.159062 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:43.159721 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:43.160362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:43.184390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] HTTP exception thrown: Instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 could not be found. Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Request method failure captured: Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 HTTP/1.1 Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR5iUEq_ah40pozbisbM5Y-gd_CuPsHi7XvQ_kLdY-eGRN7n_VOOE_lp57_izWgSoHZgNuKcMzWAbvcREi9BI-SKqhIzxuDFglxK_VsA_6mRQqxLhdzBuwoTwtVyrcXM6TbHg_7xhTzR4kEBV8rPPPYYxG9kzcwyWB_UjSSW1q1tPdM Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 98b4b754e82445a0b65e88f5dbede11b Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestShelveInstance-1436212605 Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:21:43.186423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98b4b754e82445a0b65e88f5dbede11b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98b4b754e82445a0b65e88f5dbede11b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98b4b754e82445a0b65e88f5dbede11b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98b4b754e82445a0b65e88f5dbede11b"}]}] Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestShelveInstance-1436212605 Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 98b4b754e82445a0b65e88f5dbede11b Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestShelveInstance-1436212605 Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestShelveInstance-1436212605-project Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 70c47e7154fd41a7adb4735a519f1484 Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestShelveInstance-1436212605-project Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 could not be found. Aug 29 20:21:43.188682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '9470292c-17d1-47bf-9ea3-c5b0eb069a12'} Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 could not be found. Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:21:43.189684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 could not be found. Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 could not be found. Aug 29 20:21:43.191650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:43.193812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Returning 404 to user: Instance 9470292c-17d1-47bf-9ea3-c5b0eb069a12 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:21:43.193812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e92c324e-8290-46bd-99b3-2bf336b22fae tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12" status: 404 len: 111 microversion: 2.1 time: 0.050069 Aug 29 20:21:43.193812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 440/894] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:43 2022] GET /compute/v2.1/servers/9470292c-17d1-47bf-9ea3-c5b0eb069a12 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:21:43.394631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-27b8cfce-5bbc-4f51-b861-4b7c65b8002c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] Calling method '.version_select at 0x7f15f9d471f0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:43.431718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-27b8cfce-5bbc-4f51-b861-4b7c65b8002c tempest-TestShelveInstance-1436212605 tempest-TestShelveInstance-1436212605-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-667803329" status: 202 len: 0 microversion: 2.1 time: 0.042099 Aug 29 20:21:43.432896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 455/895] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 29 20:21:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-667803329 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:21:43.994183 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:43.995371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:44.006285 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:44.009562 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:44.011865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:44.013852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:44.014741 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:44.015584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:44.036636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 HTTP/1.1 Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:21:44.039785 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:21:44.041139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '3fa729ec-2c90-4d71-ab0a-23d73b1dd267'} Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:21:44.041940 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:21:44.043117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:21:44.044185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:21:44.044185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f131405d-bdb6-4a9a-8b6c-1a4d7782cb17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 404 len: 111 microversion: 2.1 time: 0.055396 Aug 29 20:21:44.044185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 441/896] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:43 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:21:44.067165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cf2196bf-392e-4091-90c1-a1b199057bc7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '.version_select at 0x7f15f9bf81f0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:44.081844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cf2196bf-392e-4091-90c1-a1b199057bc7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647033378" status: 202 len: 0 microversion: 2.1 time: 0.033080 Aug 29 20:21:44.082881 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 456/897] 10.222.0.73 () {58 vars in 1218 bytes} [Mon Aug 29 20:21:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647033378 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:21:45.067910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fbe6831a-219f-4af9-b8e4-334d1b635d3f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: .version_select at 0x7f15f9c91a60>, body: {"keypair": {"name": "tempest-keypair-969584900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYnA8iGjdKCIHQLROM7b8BIFZjB3IEopCBP1KIXs+ZvlA/hECitsgMwBGKInOMYW1zVTNeCJxl9lYMedTM6GdnYSCDjOve82IJTpffhbCcfC3Ru8beQ5c5kzB9PQJQFrg=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:45.104493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-fbe6831a-219f-4af9-b8e4-334d1b635d3f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:45.112896 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-fbe6831a-219f-4af9-b8e4-334d1b635d3f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for user c7c8422c3d314adca25acf967ffd0998 and project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:45.154253 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fbe6831a-219f-4af9-b8e4-334d1b635d3f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094034 Aug 29 20:21:45.161373 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 442/898] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:21:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:48.187912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1682330083", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68f99afd-3890-4bbb-ac8f-4e5af64abbb6"}], "security_groups": [{"name": "tempest-securitygroup--618572902"}], "key_name": "tempest-keypair-969584900", "user_data": "}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:48.452727 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] validate_networks() for [('68f99afd-3890-4bbb-ac8f-4e5af64abbb6', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:21:49.364098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:21:49.364859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:21:49.366131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:21:49.366828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:21:49.367427 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:21:49.382813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:49.384215 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:49.385221 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:49.387193 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:49.388931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:49.389854 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:49.422514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:49.431636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for user c7c8422c3d314adca25acf967ffd0998 and project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:49.449251 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:21:49.453944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:21:49.535364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0b8eebb3-68e4-4423-8427-85c9a2d9c329 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.355090 Aug 29 20:21:49.551110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13871cb3-5d4f-42c1-b4f1-74f80a1e411c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:49.551781 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-13871cb3-5d4f-42c1-b4f1-74f80a1e411c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:49.554745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 457/899] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:21:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:21:49.800062 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13871cb3-5d4f-42c1-b4f1-74f80a1e411c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:49.811742 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13871cb3-5d4f-42c1-b4f1-74f80a1e411c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1241 microversion: 2.1 time: 0.266024 Aug 29 20:21:49.814001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 443/900] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:49 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1241 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:50.845496 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:50.847058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:50.857698 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:50.858696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:50.859409 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:50.860598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:50.861356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:50.862366 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:50.968316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:50.981896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d8a93c23-dd0e-4847-9060-cdb464f04f1a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1293 microversion: 2.1 time: 0.144543 Aug 29 20:21:50.982926 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 458/901] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:50 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1293 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:52.010616 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:52.011821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:52.044590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:52.045133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:52.051005 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:52.058308 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:52.059045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:52.059673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:52.218975 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:52.230276 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9a5ba7d5-8f08-47c5-af32-6109381e9f98 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1299 microversion: 2.1 time: 0.226684 Aug 29 20:21:52.231220 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 444/902] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:52 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:53.257219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:53.258919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:53.266373 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:53.266985 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:53.267539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:53.268308 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:53.269156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:53.269896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:53.475020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:53.484239 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0a408d80-c5db-4497-bfea-9cca586daec2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1366 microversion: 2.1 time: 0.233845 Aug 29 20:21:53.484574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 459/903] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:53 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:54.508839 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:54.510165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:54.522682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:54.523948 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:54.525246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:54.526365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:54.527091 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:54.527905 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:54.763657 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-4752329a-aea2-4a2e-bbe1-8334f44c8716 req-a8df374f-22e2-48ca-82c6-07fba2a708e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9edd36-10af-43d8-ba3c-8232ef5809af", "tag": "a9f4fe55-978c-4d8b-8bbb-d7b16d8e707b"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:54.778848 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-4752329a-aea2-4a2e-bbe1-8334f44c8716 req-a8df374f-22e2-48ca-82c6-07fba2a708e4 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:54.780674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-4752329a-aea2-4a2e-bbe1-8334f44c8716 req-a8df374f-22e2-48ca-82c6-07fba2a708e4 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:54.781354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-4752329a-aea2-4a2e-bbe1-8334f44c8716 req-a8df374f-22e2-48ca-82c6-07fba2a708e4 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:54.797921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:54.801583 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-4752329a-aea2-4a2e-bbe1-8334f44c8716 req-a8df374f-22e2-48ca-82c6-07fba2a708e4 service nova] Creating event network-changed:a9f4fe55-978c-4d8b-8bbb-d7b16d8e707b for instance 7c9edd36-10af-43d8-ba3c-8232ef5809af on hv-cinder-85426 Aug 29 20:21:54.809041 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-4752329a-aea2-4a2e-bbe1-8334f44c8716 req-a8df374f-22e2-48ca-82c6-07fba2a708e4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051236 Aug 29 20:21:54.809647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 460/904] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:21:54.976678 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:54.985783 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-54fdf694-fbef-436c-9a2c-93d416b696f8 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1366 microversion: 2.1 time: 0.484488 Aug 29 20:21:54.986408 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 445/905] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:54 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1366 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:56.022945 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:56.023964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:56.036200 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:56.036980 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:56.037784 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:56.038959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:56.039706 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:56.040439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:56.265857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:56.283255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-60bec584-a5e9-4045-bcb3-abe1dbac246d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1366 microversion: 2.1 time: 0.269932 Aug 29 20:21:56.284609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 461/906] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:56 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:57.322912 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:57.324745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:57.339355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:57.340363 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:57.342524 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:57.343675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:57.345342 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:57.346539 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:58.085108 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:58.096311 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4583fff2-68aa-44ae-97f6-34111f4d910f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1366 microversion: 2.1 time: 0.778474 Aug 29 20:21:58.097636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 446/907] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:57 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1366 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:59.125468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:59.126545 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:59.138147 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.139230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.139957 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.141157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.141961 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.142672 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.321441 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:59.336481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-edffc588-08cd-4a95-b815-da7bd7ded328 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1366 microversion: 2.1 time: 0.218010 Aug 29 20:21:59.337538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 462/908] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:21:59 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:59.365569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:59.368762 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:59.376344 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.376904 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.377364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.378125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.378561 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.379236 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.417349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4f1f7f26-a4ce-481e-9457-09b1cb051dbe tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055432 Aug 29 20:21:59.418349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 447/909] 10.222.0.73 () {60 vars in 1343 bytes} [Mon Aug 29 20:21:59 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:59.496447 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:59.497039 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:59.499131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:59.500036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=6 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:59.506112 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.507644 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.508120 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.508828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.509487 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.509745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.538977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:21:59.652580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5f37dfdc-653c-4f25-a172-88d131eb5e18 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "DELETE /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 204 len: 0 microversion: 2.20 time: 0.162119 Aug 29 20:21:59.653849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 463/910] 10.222.0.73 () {60 vars in 1280 bytes} [Mon Aug 29 20:21:59 2022] DELETE /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:21:59.664718 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:59.665340 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:59.672635 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.673110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.673978 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.675428 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.676606 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.676606 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.806314 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:59.814153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1521138452", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "networks": [{"uuid": "e9c72865-bd63-4803-99cb-49e75af2456f"}]}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:59.898509 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] validate_networks() for [('e9c72865-bd63-4803-99cb-49e75af2456f', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:21:59.906162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:59.925578 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:59.928148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:59.931386 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cb584f91-87c9-44df-a7a6-21481bc59c73 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.271398 Aug 29 20:21:59.933153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 448/911] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:21:59 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:21:59.941460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-4586b873-fde7-4555-9e4f-997fd9885037 req-301a8020-05bb-40d2-bd8e-0012ea13f5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9edd36-10af-43d8-ba3c-8232ef5809af", "name": "network-vif-plugged", "status": "completed", "tag": "a9f4fe55-978c-4d8b-8bbb-d7b16d8e707b"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:59.960145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4586b873-fde7-4555-9e4f-997fd9885037 req-301a8020-05bb-40d2-bd8e-0012ea13f5e5 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.960648 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4586b873-fde7-4555-9e4f-997fd9885037 req-301a8020-05bb-40d2-bd8e-0012ea13f5e5 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.961251 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4586b873-fde7-4555-9e4f-997fd9885037 req-301a8020-05bb-40d2-bd8e-0012ea13f5e5 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.981276 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-4586b873-fde7-4555-9e4f-997fd9885037 req-301a8020-05bb-40d2-bd8e-0012ea13f5e5 service nova] Creating event network-vif-plugged:a9f4fe55-978c-4d8b-8bbb-d7b16d8e707b for instance 7c9edd36-10af-43d8-ba3c-8232ef5809af on hv-cinder-85426 Aug 29 20:21:59.990291 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-4586b873-fde7-4555-9e4f-997fd9885037 req-301a8020-05bb-40d2-bd8e-0012ea13f5e5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054600 Aug 29 20:21:59.992984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 449/912] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:00.364242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:00.364985 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:00.368658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:22:00.369860 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:22:00.369860 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:22:00.370040 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:22:00.370365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:22:00.374646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.375521 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.375696 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.376410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.377854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.378221 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.381107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.382467 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.383102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.384662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.385559 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.386168 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.412743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Getting quotas for project 3d6b1e6a93214e0fbe67b7dfb84f1043. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:22:00.418823 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Getting quotas for user 47d7f801e70d4e08b73a83451fd522b1 and project 3d6b1e6a93214e0fbe67b7dfb84f1043. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:22:00.432358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:22:00.435329 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:22:00.458527 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:00.494989 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-261e8319-63c5-49bf-a2c2-52a7bec901e0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689228 Aug 29 20:22:00.496145 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 464/913] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:21:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:22:00.512504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0e361d65-bca3-4973-9632-e2895c887463 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:00.513326 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0e361d65-bca3-4973-9632-e2895c887463 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:00.584130 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:00.594403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-630eba3c-de91-4914-809e-f5915b771772 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1366 microversion: 2.1 time: 0.236017 Aug 29 20:22:00.594984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 450/914] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:00 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:00.606515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0e361d65-bca3-4973-9632-e2895c887463 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:00.614428 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0e361d65-bca3-4973-9632-e2895c887463 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1219 microversion: 2.1 time: 0.106980 Aug 29 20:22:00.615006 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 465/915] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:00 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:00.969584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:00.970613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:00.983023 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.983727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.984246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.985470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.986306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.987094 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.181323 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:01.190980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:01.192699 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:01.193957 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d1a23141-06e8-4aa8-bb20-a472c265f826 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.228361 Aug 29 20:22:01.194526 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 451/916] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:22:00 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:22:01.622763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:01.623601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:01.630665 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.631110 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.632177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.632914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.633510 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.633925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.641826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:01.643096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:01.654454 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.659326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.659326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.659326 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.660883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.661884 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.765462 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:01.774236 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e5cfb632-836c-4c19-aced-75077a665e9e tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1223 microversion: 2.1 time: 0.140928 Aug 29 20:22:01.774737 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 452/917] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:01 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:01.826312 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:01.834322 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-26e04906-60eb-4c70-997f-d1bde61a3477 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1366 microversion: 2.1 time: 0.215479 Aug 29 20:22:01.835068 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 466/918] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:01 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:02.218133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:02.218947 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:02.226694 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.227311 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.227837 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.228685 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.229221 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.229737 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.524765 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:02.534324 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:02.535931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:02.536906 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b0761ec4-0343-4d1b-a1c3-c4f861cd3786 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1724 microversion: 2.20 time: 0.322902 Aug 29 20:22:02.537999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 453/919] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:22:02 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:22:02.798252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:02.799128 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:02.807235 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.807930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.808361 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.809282 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.809754 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.810183 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.855731 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:02.856660 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:02.863374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.863951 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.864459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.871415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.871415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.871415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.903979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:02.915565 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9c4cf50a-d713-43f0-9717-4a825656ac7d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1271 microversion: 2.1 time: 0.120372 Aug 29 20:22:02.916197 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 467/920] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:02 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:03.150165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-c98c1787-0ea8-49ba-b29a-d99908ff6e1e req-a599cfa6-7bcc-4456-ade0-7ae629384fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4563b2-c0de-4300-be32-5faa8f8476d8", "name": "network-vif-deleted", "tag": "1ab12c9b-86bb-41bd-aab2-ca30f835e85d"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:03.151716 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:03.163747 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1b0c85ea-e24b-49ea-8afb-49d304c0e870 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1366 microversion: 2.1 time: 0.310998 Aug 29 20:22:03.164384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 454/921] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:02 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:03.176791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c98c1787-0ea8-49ba-b29a-d99908ff6e1e req-a599cfa6-7bcc-4456-ade0-7ae629384fc3 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.177764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c98c1787-0ea8-49ba-b29a-d99908ff6e1e req-a599cfa6-7bcc-4456-ade0-7ae629384fc3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.178369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-c98c1787-0ea8-49ba-b29a-d99908ff6e1e req-a599cfa6-7bcc-4456-ade0-7ae629384fc3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:03.194695 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-c98c1787-0ea8-49ba-b29a-d99908ff6e1e req-a599cfa6-7bcc-4456-ade0-7ae629384fc3 service nova] Creating event network-vif-deleted:1ab12c9b-86bb-41bd-aab2-ca30f835e85d for instance eb4563b2-c0de-4300-be32-5faa8f8476d8 on hv-cinder-85426 Aug 29 20:22:03.202266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-c98c1787-0ea8-49ba-b29a-d99908ff6e1e req-a599cfa6-7bcc-4456-ade0-7ae629384fc3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060467 Aug 29 20:22:03.203199 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 468/922] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:22:03.566460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:03.567441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:03.578807 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.579266 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.580078 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:03.580794 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.581281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.581727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:03.604973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:03.669671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:03.684944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:03.688382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:03.691107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-179f124d-f4e3-487b-ad47-cefe12da8598 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1657 microversion: 2.20 time: 0.128346 Aug 29 20:22:03.702224 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 455/923] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:22:03 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1657 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:22:03.947096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:03.948630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:03.963021 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.963729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.964356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:03.965270 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.965915 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.966601 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.067804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:04.077833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4a4f32d9-9678-4d74-9b62-3cfcf2da3b07 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1279 microversion: 2.1 time: 0.137329 Aug 29 20:22:04.078146 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 469/924] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:03 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1279 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:04.197421 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:04.198176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:04.205335 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.206045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.207531 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.207531 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.208528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.208528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.395836 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:04.408037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7f292a0e-824e-4952-bc4a-958715d324fb tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1556 microversion: 2.1 time: 0.215306 Aug 29 20:22:04.409462 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 456/925] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:04 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1556 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:04.437652 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:04.438439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:04.448685 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.449230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.449855 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.450673 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.451245 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.451834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.602803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-562534d7-3284-4278-93f8-9c8b059fd1c5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170942 Aug 29 20:22:04.604507 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 470/926] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 29 20:22:04 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:04.731690 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:04.734102 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:04.747384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.748357 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.749294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.750597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.751410 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.752161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.812276 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.813476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.814289 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.815745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lazy-loading 'fault' on Instance uuid eb4563b2-c0de-4300-be32-5faa8f8476d8 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:22:04.893862 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:04.908035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:04.910341 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ffc617c50984f83adc3269b118c8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc733dcfcf9043feb354598fc2792ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:04.914340 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0432e8b5-5d92-4695-9bc2-25415f31ad0a tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 200 len: 1372 microversion: 2.20 time: 0.188305 Aug 29 20:22:04.930192 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 457/927] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:22:04 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:22:05.114425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:05.114979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:05.130780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:05.132282 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:05.133019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:05.134297 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:05.135337 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:05.136089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:05.263442 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:05.276920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-392f72d6-a637-4580-a01f-0864b7c17b87 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1277 microversion: 2.1 time: 0.173338 Aug 29 20:22:05.290363 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 471/928] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:05 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:05.950984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:05.952047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:05.965429 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:05.966217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:05.966922 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:05.968489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:05.969339 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:05.971866 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:05.993306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] HTTP exception thrown: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Request method failure captured: Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 HTTP/1.1 Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR4pPQ1lFxlfk53v_ttIYVjYasNPSK0IOJ1okVSF-zBXzPNLfiP_5py6-1aZ0--zxUkmKRtITU3EOE7aM4-V89rvtKtdPaI9-bq9_7unnwLLev_-vXgzzC2WEYNcwNlx38MT_c1RXOR5JM5qpSGDk36XzzR5APCSL7oK-85oGwd9Wu8 Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:22:05.995164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fc733dcfcf9043feb354598fc2792ff5"}]}] Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 1ffc617c50984f83adc3269b118c8a91 Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:05.997972 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'eb4563b2-c0de-4300-be32-5faa8f8476d8'} Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:22:05.999659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:06.002051 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:06.004195 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Returning 404 to user: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:22:06.010380 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5e2bf325-ca24-420c-9456-c051ab28cf31 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 404 len: 111 microversion: 2.20 time: 0.052657 Aug 29 20:22:06.011264 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 458/929] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:22:05 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:22:06.024386 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-af24d994-079b-4d53-a0a1-c5871ec28559 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '.version_select at 0x7f15f9bf3700>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:06.058491 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-af24d994-079b-4d53-a0a1-c5871ec28559 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039160063" status: 204 len: 0 microversion: 2.20 time: 0.041206 Aug 29 20:22:06.060049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 472/930] 10.222.0.73 () {60 vars in 1262 bytes} [Mon Aug 29 20:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039160063 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 20:22:06.308164 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:06.309595 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:06.341833 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:06.345228 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-e4e83b03-abd4-42a8-b936-580987c0f30a req-9e1139f9-acdc-44f7-bc64-6c88c2beedd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9edd36-10af-43d8-ba3c-8232ef5809af", "tag": "a9f4fe55-978c-4d8b-8bbb-d7b16d8e707b"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:06.349046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:06.350769 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:06.356441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:06.357612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:06.358790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:06.364229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e4e83b03-abd4-42a8-b936-580987c0f30a req-9e1139f9-acdc-44f7-bc64-6c88c2beedd2 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:06.364913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e4e83b03-abd4-42a8-b936-580987c0f30a req-9e1139f9-acdc-44f7-bc64-6c88c2beedd2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:06.365411 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-e4e83b03-abd4-42a8-b936-580987c0f30a req-9e1139f9-acdc-44f7-bc64-6c88c2beedd2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:06.382815 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-e4e83b03-abd4-42a8-b936-580987c0f30a req-9e1139f9-acdc-44f7-bc64-6c88c2beedd2 service nova] Creating event network-changed:a9f4fe55-978c-4d8b-8bbb-d7b16d8e707b for instance 7c9edd36-10af-43d8-ba3c-8232ef5809af on hv-cinder-85426 Aug 29 20:22:06.390096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-e4e83b03-abd4-42a8-b936-580987c0f30a req-9e1139f9-acdc-44f7-bc64-6c88c2beedd2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050513 Aug 29 20:22:06.392005 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 473/931] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:06.752565 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:06.764406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-903f8cdf-3f13-4e90-9812-2d7c6eb3b08c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1319 microversion: 2.1 time: 0.463349 Aug 29 20:22:06.764981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 459/932] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:06 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:07.031293 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-05963540-dd7a-48dd-8032-ddb14f98b2e5 req-8d31fef8-8711-490b-9997-c591364b8225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a39c75-450f-47b4-b540-56605b41f89d", "tag": "0583f15b-4997-4fe9-ac45-41bece32f59a"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:07.047975 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-05963540-dd7a-48dd-8032-ddb14f98b2e5 req-8d31fef8-8711-490b-9997-c591364b8225 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:07.049165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-05963540-dd7a-48dd-8032-ddb14f98b2e5 req-8d31fef8-8711-490b-9997-c591364b8225 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:07.050649 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-05963540-dd7a-48dd-8032-ddb14f98b2e5 req-8d31fef8-8711-490b-9997-c591364b8225 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:07.072345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-05963540-dd7a-48dd-8032-ddb14f98b2e5 req-8d31fef8-8711-490b-9997-c591364b8225 service nova] Creating event network-changed:0583f15b-4997-4fe9-ac45-41bece32f59a for instance 85a39c75-450f-47b4-b540-56605b41f89d on hv-cinder-85426 Aug 29 20:22:07.081047 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-05963540-dd7a-48dd-8032-ddb14f98b2e5 req-8d31fef8-8711-490b-9997-c591364b8225 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055899 Aug 29 20:22:07.082857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 474/933] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:07.811829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:07.812829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:07.820989 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:07.821551 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:07.822115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:07.823005 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:07.823664 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:07.824238 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:08.014074 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:08.028919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dfb7f001-0e73-49e1-aa5b-9ea9a7aa251c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1319 microversion: 2.1 time: 0.222681 Aug 29 20:22:08.029689 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 460/934] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:07 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:09.055852 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:09.056966 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:09.066034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:09.066782 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:09.067596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:09.068574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:09.069790 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:09.070709 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:09.080899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:09.081902 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:09.094043 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:09.095003 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:09.095917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:09.097314 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:09.098406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:09.099369 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:09.124524 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] HTTP exception thrown: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Request method failure captured: Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 HTTP/1.1 Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR4pPQ1lFxlfk53v_ttIYVjYasNPSK0IOJ1okVSF-zBXzPNLfiP_5py6-1aZ0--zxUkmKRtITU3EOE7aM4-V89rvtKtdPaI9-bq9_7unnwLLev_-vXgzzC2WEYNcwNlx38MT_c1RXOR5JM5qpSGDk36XzzR5APCSL7oK-85oGwd9Wu8 Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:22:09.126118 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fc733dcfcf9043feb354598fc2792ff5"}]}] Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 1ffc617c50984f83adc3269b118c8a91 Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.127878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'eb4563b2-c0de-4300-be32-5faa8f8476d8'} Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:22:09.128778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.130258 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.132236 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Returning 404 to user: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:22:09.133135 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-abb67537-b16f-4ad8-9987-2ea0b2d14dc2 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "DELETE /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 404 len: 111 microversion: 2.20 time: 0.056452 Aug 29 20:22:09.136197 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 461/935] 10.222.0.73 () {60 vars in 1280 bytes} [Mon Aug 29 20:22:09 2022] DELETE /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:22:09.146223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:09.148213 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: eb4563b2-c0de-4300-be32-5faa8f8476d8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:09.160227 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:09.161067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:09.161849 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:09.165963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:09.166964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:09.167636 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:09.187590 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] HTTP exception thrown: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Request method failure captured: Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 HTTP/1.1 Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR4pPQ1lFxlfk53v_ttIYVjYasNPSK0IOJ1okVSF-zBXzPNLfiP_5py6-1aZ0--zxUkmKRtITU3EOE7aM4-V89rvtKtdPaI9-bq9_7unnwLLev_-vXgzzC2WEYNcwNlx38MT_c1RXOR5JM5qpSGDk36XzzR5APCSL7oK-85oGwd9Wu8 Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:22:09.189374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fc733dcfcf9043feb354598fc2792ff5"}]}] Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 1ffc617c50984f83adc3269b118c8a91 Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.192558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'eb4563b2-c0de-4300-be32-5faa8f8476d8'} Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:22:09.194233 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. Aug 29 20:22:09.196963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:22:09.199596 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Returning 404 to user: Instance eb4563b2-c0de-4300-be32-5faa8f8476d8 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:22:09.199596 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6b848c06-8c69-45ff-aa00-c5363f5f9a55 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8" status: 404 len: 111 microversion: 2.20 time: 0.051688 Aug 29 20:22:09.199596 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 462/936] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:22:09 2022] GET /compute/v2.1/servers/eb4563b2-c0de-4300-be32-5faa8f8476d8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:22:09.358379 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:09.375337 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-17d1580f-3373-42f9-b176-eebc10cc1631 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1319 microversion: 2.1 time: 0.325485 Aug 29 20:22:09.375992 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 475/937] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:09 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:10.402986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:10.402986 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:10.409896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:10.410739 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:10.412349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:10.413722 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:10.414091 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:10.414446 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:10.415610 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:10.416365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:10.416994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:10.420952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:10.421558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:10.421948 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:10.422659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:10.423109 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:10.423530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:10.441490 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] HTTP exception thrown: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Request method failure captured: Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: DELETE /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad HTTP/1.1 Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR4pPQ1lFxlfk53v_ttIYVjYasNPSK0IOJ1okVSF-zBXzPNLfiP_5py6-1aZ0--zxUkmKRtITU3EOE7aM4-V89rvtKtdPaI9-bq9_7unnwLLev_-vXgzzC2WEYNcwNlx38MT_c1RXOR5JM5qpSGDk36XzzR5APCSL7oK-85oGwd9Wu8 Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:22:10.444891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fc733dcfcf9043feb354598fc2792ff5"}]}] Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 1ffc617c50984f83adc3269b118c8a91 Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.447743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'b86403f3-4482-4e27-9f97-cdf8fc2dd9ad'} Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:22:10.449202 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.451803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.454647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Returning 404 to user: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:22:10.454647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b50d1538-92c1-4981-ae30-7b932cdf3ed9 tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 404 len: 111 microversion: 2.20 time: 0.040446 Aug 29 20:22:10.454647 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 476/938] 10.222.0.73 () {60 vars in 1280 bytes} [Mon Aug 29 20:22:10 2022] DELETE /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:22:10.458665 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:10.459837 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] [instance: b86403f3-4482-4e27-9f97-cdf8fc2dd9ad] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:10.471161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:10.471891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:10.472480 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:10.473426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:10.474089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:10.475658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:10.497537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] HTTP exception thrown: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Request method failure captured: Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad HTTP/1.1 Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR4pPQ1lFxlfk53v_ttIYVjYasNPSK0IOJ1okVSF-zBXzPNLfiP_5py6-1aZ0--zxUkmKRtITU3EOE7aM4-V89rvtKtdPaI9-bq9_7unnwLLev_-vXgzzC2WEYNcwNlx38MT_c1RXOR5JM5qpSGDk36XzzR5APCSL7oK-85oGwd9Wu8 Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:22:10.500658 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fc733dcfcf9043feb354598fc2792ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fc733dcfcf9043feb354598fc2792ff5"}]}] Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: fc733dcfcf9043feb354598fc2792ff5 Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-392249623 Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 1ffc617c50984f83adc3269b118c8a91 Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-392249623-project Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.503280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'b86403f3-4482-4e27-9f97-cdf8fc2dd9ad'} Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:22:10.504845 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. Aug 29 20:22:10.508053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:22:10.510111 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] Returning 404 to user: Instance b86403f3-4482-4e27-9f97-cdf8fc2dd9ad could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:22:10.510111 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4d1a85c9-38f1-4c66-b813-5c803567745e tempest-AttachVolumeShelveTestJSON-392249623 tempest-AttachVolumeShelveTestJSON-392249623-project] 10.222.0.73 "GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad" status: 404 len: 111 microversion: 2.20 time: 0.050163 Aug 29 20:22:10.510111 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 477/939] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 29 20:22:10 2022] GET /compute/v2.1/servers/b86403f3-4482-4e27-9f97-cdf8fc2dd9ad => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:22:10.637011 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:10.649001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-08bd65fb-fdf9-4762-b39d-eb0e2c3ac620 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1319 microversion: 2.1 time: 0.251902 Aug 29 20:22:10.650505 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 463/940] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:10 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:11.683667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:11.684679 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:11.687170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=8 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:11.698131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:11.700060 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:11.700241 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:11.701922 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:11.703475 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:11.704066 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:11.908637 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-e4841a5a-af75-4b49-907e-8f86f4c3b5d4 req-343d64c9-cd4a-42da-a6ea-b66d7df7e9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a39c75-450f-47b4-b540-56605b41f89d", "name": "network-vif-plugged", "status": "completed", "tag": "0583f15b-4997-4fe9-ac45-41bece32f59a"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:11.923745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4841a5a-af75-4b49-907e-8f86f4c3b5d4 req-343d64c9-cd4a-42da-a6ea-b66d7df7e9db service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:11.924269 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4841a5a-af75-4b49-907e-8f86f4c3b5d4 req-343d64c9-cd4a-42da-a6ea-b66d7df7e9db service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:11.924991 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4841a5a-af75-4b49-907e-8f86f4c3b5d4 req-343d64c9-cd4a-42da-a6ea-b66d7df7e9db service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:11.961193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-e4841a5a-af75-4b49-907e-8f86f4c3b5d4 req-343d64c9-cd4a-42da-a6ea-b66d7df7e9db service nova] Creating event network-vif-plugged:0583f15b-4997-4fe9-ac45-41bece32f59a for instance 85a39c75-450f-47b4-b540-56605b41f89d on hv-cinder-85426 Aug 29 20:22:11.968226 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-e4841a5a-af75-4b49-907e-8f86f4c3b5d4 req-343d64c9-cd4a-42da-a6ea-b66d7df7e9db service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063335 Aug 29 20:22:11.968825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 464/941] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:22:12.018879 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:12.038015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-72b23a6f-6df0-4c41-9709-54f92743576a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1319 microversion: 2.1 time: 0.357874 Aug 29 20:22:12.040114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 478/942] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:11 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:13.065414 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:13.066662 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:13.078664 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:13.079497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:13.080459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:13.081755 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:13.083523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:13.084707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:13.327686 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:13.341586 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9bdaa202-2ba5-414e-b99b-3cd2ad786740 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1319 microversion: 2.1 time: 0.284206 Aug 29 20:22:13.342550 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 465/943] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:13 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:14.369349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:14.370354 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:14.381631 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:14.382436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:14.383071 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:14.384147 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:14.384851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:14.385498 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:14.642213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:14.670220 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bbc90bfc-fb8a-44b8-a3fb-1328b6b743ad tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1508 microversion: 2.1 time: 0.306900 Aug 29 20:22:14.677773 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 479/944] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:22:14 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:18.676815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ee4d43ea-0d75-490b-8cde-a59560368ee3 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15f9c91ca0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:18.750042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ee4d43ea-0d75-490b-8cde-a59560368ee3 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0e6af909-a03f-41d7-b835-1da1b99372c1" status: 200 len: 351 microversion: 2.1 time: 0.077672 Aug 29 20:22:18.750907 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 466/945] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:22:18 2022] GET /compute/v2.1/os-volumes/0e6af909-a03f-41d7-b835-1da1b99372c1 => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:20.256374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-18f2b176-1976-469f-b3aa-ec4b71fcd804 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15f9e11940>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:20.336921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-18f2b176-1976-469f-b3aa-ec4b71fcd804 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/74f013ee-4dec-4d6c-aca7-bab049d25487" status: 200 len: 350 microversion: 2.1 time: 0.087670 Aug 29 20:22:20.337691 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 480/946] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:22:20 2022] GET /compute/v2.1/os-volumes/74f013ee-4dec-4d6c-aca7-bab049d25487 => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:21.938476 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f29ceba2-65d0-433e-9d2c-ce4cfbfe8cdb tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15f9d85b80>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:21.996753 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f29ceba2-65d0-433e-9d2c-ce4cfbfe8cdb tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/489e1a29-4a3a-4e88-a363-167839234b40" status: 200 len: 349 microversion: 2.1 time: 0.065217 Aug 29 20:22:21.997815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 467/947] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:22:21 2022] GET /compute/v2.1/os-volumes/489e1a29-4a3a-4e88-a363-167839234b40 => generated 349 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:22:22.018920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a6f6f95b-d15e-4adc-ba16-ab03d495638a tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15f9dd7670>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:22.164580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a6f6f95b-d15e-4adc-ba16-ab03d495638a tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.153605 Aug 29 20:22:22.165148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 481/948] 10.222.0.73 () {58 vars in 1134 bytes} [Mon Aug 29 20:22:22 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:22.181044 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7c38633f-eeb7-4d75-bb77-5c660e4652c0 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15f9d67af0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:22.318735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7c38633f-eeb7-4d75-bb77-5c660e4652c0 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.142238 Aug 29 20:22:22.319635 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 468/949] 10.222.0.73 () {58 vars in 1149 bytes} [Mon Aug 29 20:22:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:22.339954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7208bc6e-fb2a-483f-92fe-c19e129aa3b9 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15fa0c9550>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:22.448760 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7208bc6e-fb2a-483f-92fe-c19e129aa3b9 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.114212 Aug 29 20:22:22.449600 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 482/950] 10.222.0.73 () {58 vars in 1134 bytes} [Mon Aug 29 20:22:22 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:22.468459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-08673e7e-fcd7-4f29-8a19-05cf0e5c95b2 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15f9d850d0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:22.600368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-08673e7e-fcd7-4f29-8a19-05cf0e5c95b2 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.136913 Aug 29 20:22:22.601205 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 469/951] 10.222.0.73 () {58 vars in 1167 bytes} [Mon Aug 29 20:22:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:22:22.621213 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b18e1aec-92c2-4281-be14-227ee7a1d2e6 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15fa0c50d0>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:22.774545 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b18e1aec-92c2-4281-be14-227ee7a1d2e6 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.158103 Aug 29 20:22:22.775443 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 483/952] 10.222.0.73 () {58 vars in 1170 bytes} [Mon Aug 29 20:22:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:22.794217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7fe278a0-a3a9-4c7c-a669-ad6d1ce34950 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15f9c91700>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:22.935591 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7fe278a0-a3a9-4c7c-a669-ad6d1ce34950 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.146331 Aug 29 20:22:22.936521 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 470/953] 10.222.0.73 () {58 vars in 1155 bytes} [Mon Aug 29 20:22:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:22.954864 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-09a847c6-0de8-4a1f-93cd-3ad076005710 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15fa0c9b80>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:23.107423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-09a847c6-0de8-4a1f-93cd-3ad076005710 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.156172 Aug 29 20:22:23.108345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 484/954] 10.222.0.73 () {58 vars in 1188 bytes} [Mon Aug 29 20:22:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:23.130997 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:23.138559 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02065094-d8e3-488b-a75a-a76fb0afa223 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] Calling method '.version_select at 0x7f15f9e12dc0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:23.287074 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-02065094-d8e3-488b-a75a-a76fb0afa223 tempest-VolumesTestJSON-1316020633 tempest-VolumesTestJSON-1316020633-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.158599 Aug 29 20:22:23.287938 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 471/955] 10.222.0.73 () {58 vars in 1155 bytes} [Mon Aug 29 20:22:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:39.340241 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:39.341201 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:39.346747 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00b5806c-8328-4ce9-a137-8fd49a7b25e6", "device": "/dev/sdb"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:39.350012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:39.358280 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:39.358757 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:39.359210 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:39.359914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:39.360349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:39.360764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:39.928207 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d9151da9-593b-435c-a2bf-c0bcdabf307a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "POST /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.588697 Aug 29 20:22:39.929368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 485/956] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:22:39 2022] POST /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:01.101243 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=48 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:01.107665 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a47536dd-0297-46e3-b3c4-6752b6dfcbba tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Action: 'create', calling method: .version_select at 0x7f15f9d85e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1618751018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGemAnW1jnhkftiCiPyhONe56cNlV5Ke9Ozmi8QrduRKZFFm4RkhNSM5cyxord7MtJRRbwWayC1ru3hYMsQN6udFh2SCmcDS8LF06zpwZbslnd69iE5dIKdrcLmNw7gbXg=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:01.124926 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-a47536dd-0297-46e3-b3c4-6752b6dfcbba tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Getting quotas for project 9f9f5a2386e2451f9a9b833859343595. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:23:01.129073 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-a47536dd-0297-46e3-b3c4-6752b6dfcbba tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Getting quotas for user fc11bab9d92c48e3938593035b837da1 and project 9f9f5a2386e2451f9a9b833859343595. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:23:01.162115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a47536dd-0297-46e3-b3c4-6752b6dfcbba tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061205 Aug 29 20:23:01.163066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 472/957] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:23:01 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:01.224402 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:01.225240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:01.231448 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1748662428", "imageRef": "1009b575-a764-4b7e-ab18-ff45bdae7b24", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1618751018", "networks": [{"uuid": "72f342c8-cf40-409f-b436-aa5b868afdf8"}]}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:01.301164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] validate_networks() for [('72f342c8-cf40-409f-b436-aa5b868afdf8', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:23:01.804627 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:23:01.805764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:23:01.805764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:23:01.806210 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:23:01.806739 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:23:01.817148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:01.817625 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:01.818086 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:01.818891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:01.819294 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:01.819714 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:01.836997 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Getting quotas for project 9f9f5a2386e2451f9a9b833859343595. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:23:01.842535 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Getting quotas for user fc11bab9d92c48e3938593035b837da1 and project 9f9f5a2386e2451f9a9b833859343595. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:23:01.855714 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:23:01.858084 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1009b575-a764-4b7e-ab18-ff45bdae7b24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:23:01.905053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-25e8244c-efc2-4455-b6d2-bb9782f223c0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682133 Aug 29 20:23:01.906511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 486/958] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:23:01.914242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:23:01.914464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Mon Aug 29 20:23:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 (ip 10.222.0.73) !!! Aug 29 20:23:01.921032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7cfbb68d-d30f-45ba-acd4-1bf1c972c0ef tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:01.921656 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7cfbb68d-d30f-45ba-acd4-1bf1c972c0ef tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:02.240030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7cfbb68d-d30f-45ba-acd4-1bf1c972c0ef tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:02.251667 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7cfbb68d-d30f-45ba-acd4-1bf1c972c0ef tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1259 microversion: 2.1 time: 0.338073 Aug 29 20:23:02.253153 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 473/959] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:01 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:03.272577 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:03.273192 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:03.282133 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:03.282612 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:03.283047 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:03.283748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:03.284207 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:03.284630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:03.351113 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:03.360118 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1dc8580b-4a64-401e-ac0b-6353510c8e60 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1311 microversion: 2.1 time: 0.091432 Aug 29 20:23:03.360759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 487/960] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:03 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:04.385415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:04.386508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:04.402064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:04.406149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:04.411137 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:04.412800 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:04.421998 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:04.423758 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:04.620717 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:04.621584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:04.634327 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:04.635290 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:04.641676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:04.644070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:04.652652 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:04.656363 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:04.743837 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:04.756911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a1992a27-dc4e-44b4-90ac-ba58bf9968dc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.376894 Aug 29 20:23:04.777491 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 474/961] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:04 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:04.784305 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:04.785311 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:04.795830 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:04.797010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:04.797892 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:04.799296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:04.800231 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:04.801235 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:04.867259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9eed1a77-ea97-4371-a84a-eb2d8a1da360 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/ips" status: 200 len: 149 microversion: 2.1 time: 0.086603 Aug 29 20:23:04.870657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 475/962] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:23:04 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:04.899253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lazy-loading 'services' on Instance uuid 85a39c75-450f-47b4-b540-56605b41f89d {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:05.085340 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-3001b4ce-9004-4df6-a7c9-efd522082283 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "DELETE /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d/os-volume_attachments/00b5806c-8328-4ce9-a137-8fd49a7b25e6" status: 202 len: 0 microversion: 2.1 time: 0.468829 Aug 29 20:23:05.090742 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 488/963] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:23:04 2022] DELETE /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d/os-volume_attachments/00b5806c-8328-4ce9-a137-8fd49a7b25e6 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:23:05.794504 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:05.796303 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:05.808981 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:05.809748 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:05.811099 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:05.813396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:05.813396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:05.813396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:06.014960 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:06.029937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-77191102-e9bb-4437-9416-b03ed81f8c13 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.246412 Aug 29 20:23:06.032161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 476/964] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:05 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:06.513092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "708581b5-2206-4f3f-96bf-134877343710"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:06.516365 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:06.524875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:06.525350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:06.526753 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:06.527847 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:06.528272 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:06.528798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:07.063110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:07.063663 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:07.072109 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:07.073573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:07.074346 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:07.075204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:07.075751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:07.076324 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:07.301967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:07.313691 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b26c67f5-0cb2-4607-9daf-dc15dccea067 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.256339 Aug 29 20:23:07.314470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 477/965] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:07 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:08.337311 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:08.338796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:08.353973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:08.355934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:08.357211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:08.358954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:08.359906 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:08.361342 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:08.564851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:08.573441 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-70c2bf21-be4f-4e74-a774-bf6f956118f7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.240077 Aug 29 20:23:08.574635 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 478/966] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:08 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:09.598502 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:09.599571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:09.606745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:09.607227 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:09.607669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:09.608379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:09.608829 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:09.609254 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:09.785121 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:09.795814 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7a1b9a67-f1ef-4a51-8213-912873409f83 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.201083 Aug 29 20:23:09.796779 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 479/967] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:09 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:10.834120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:10.836547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:10.849245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:10.850614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:10.851663 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:10.853276 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:10.855545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:10.856626 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:11.053055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:11.061658 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dbf9b4f4-31a6-455d-8e36-b3f3450cf1f0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.242129 Aug 29 20:23:11.063187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 480/968] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:10 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:11.826341 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.850739 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=6 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:12.092724 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:12.093522 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:12.106490 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:12.107067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:12.107569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:12.108365 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:12.108844 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:12.109259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:12.249273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:12.303471 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:12.317733 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2457a463-8c2a-4d60-b190-082ade2a7850 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.230244 Aug 29 20:23:12.318423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 481/969] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:12 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:13.338893 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:13.339621 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:13.346535 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:13.347006 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:13.347433 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:13.348162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:13.348637 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:13.349030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:13.526312 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:13.541421 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b8f34ba4-053f-4cc1-b3c0-871dde3f77e3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.205608 Aug 29 20:23:13.542893 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 482/970] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:13 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:14.568105 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:14.569024 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:14.578043 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:14.578720 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:14.579301 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:14.580226 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:14.580821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:14.581409 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:14.590401 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-50817dc7-af66-40f0-9c45-865f810b1c32 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.084901 Aug 29 20:23:14.591112 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 489/971] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:23:06 2022] POST /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 194 bytes in 8087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:14.764262 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:14.773534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e87104fc-ca53-4fa8-bd1a-0ef813ebcafb tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.209698 Aug 29 20:23:14.774149 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 483/972] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:14 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:15.062506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-d13fa79e-ff17-4682-abd4-941e667f4872 req-7f15870d-ce59-4b7a-8c55-c77732798c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2440bc1d-da88-474e-85cd-05ca2f4c4f45", "tag": "fc186e24-1eed-41aa-8b3e-068089cecf38"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:15.075274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d13fa79e-ff17-4682-abd4-941e667f4872 req-7f15870d-ce59-4b7a-8c55-c77732798c07 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:15.075854 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d13fa79e-ff17-4682-abd4-941e667f4872 req-7f15870d-ce59-4b7a-8c55-c77732798c07 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:15.076369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d13fa79e-ff17-4682-abd4-941e667f4872 req-7f15870d-ce59-4b7a-8c55-c77732798c07 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:15.089146 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-d13fa79e-ff17-4682-abd4-941e667f4872 req-7f15870d-ce59-4b7a-8c55-c77732798c07 service nova] Creating event network-changed:fc186e24-1eed-41aa-8b3e-068089cecf38 for instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 on hv-cinder-85426 Aug 29 20:23:15.093676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-d13fa79e-ff17-4682-abd4-941e667f4872 req-7f15870d-ce59-4b7a-8c55-c77732798c07 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036835 Aug 29 20:23:15.094739 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 490/973] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:15.797684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:15.798416 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:15.805980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:15.806465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:15.806896 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:15.807607 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:15.808052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:15.808473 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:15.971151 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:15.983272 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-07ceea7d-6dd6-4778-9eb7-b76be8fa4afd tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.189850 Aug 29 20:23:15.983853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 484/974] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:15 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:16.036799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:16.037392 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:16.044664 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:16.045152 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:16.045993 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:16.046317 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:16.046950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:16.047374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:16.078071 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:23:16.190211 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b31b0bd5-4114-4a87-82c0-693e4f4f913c tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "DELETE /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 204 len: 0 microversion: 2.1 time: 0.157152 Aug 29 20:23:16.191436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 491/975] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:23:16 2022] DELETE /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:23:16.201037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:16.209206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:16.209206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:16.209756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:16.210753 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:16.211853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:16.212393 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:16.212861 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:16.387189 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:16.396751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fc17ed0d-4801-4b35-9f30-f4cccb3a1848 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1514 microversion: 2.1 time: 0.200894 Aug 29 20:23:16.398442 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 485/976] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:16 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:17.018118 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:17.018715 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:17.026085 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:17.026574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:17.027003 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:17.027704 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:17.028154 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:17.028568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:17.185138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:17.194456 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-65f52b7c-fb2c-426e-b2ab-0dfbda16241a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.180769 Aug 29 20:23:17.195046 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 492/977] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:17 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:17.420572 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:17.421381 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:17.429301 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:17.429813 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:17.430921 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:17.431683 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:17.432162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:17.432629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:17.602965 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:17.611263 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-567de259-009c-431f-9da1-0664c5279358 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1514 microversion: 2.1 time: 0.196104 Aug 29 20:23:17.611924 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 486/978] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:17 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:18.215825 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:18.216454 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:18.223303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:18.223785 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:18.224218 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:18.224919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:18.225368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:18.225828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:18.370673 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:18.378594 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f80fe299-5a53-49ae-a64b-29eac257d7ae tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.166830 Aug 29 20:23:18.379171 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 493/979] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:18 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:18.635925 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:18.636479 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:18.643099 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:18.643573 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:18.643998 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:18.644772 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:18.645323 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:18.645849 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:18.793234 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:18.801156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4e8b2c99-fa27-4e4d-b08c-59e212fea984 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1514 microversion: 2.1 time: 0.169456 Aug 29 20:23:18.801759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 487/980] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:18 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:19.404615 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:19.405329 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:19.412436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:19.414818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:19.415488 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:19.416448 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:19.417121 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:19.417804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:19.468201 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-1c64de58-a7fc-4478-a57d-1467e0e2b276 req-56ed01a0-7542-4322-b77e-f05499555fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a39c75-450f-47b4-b540-56605b41f89d", "name": "network-vif-deleted", "tag": "0583f15b-4997-4fe9-ac45-41bece32f59a"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:19.479713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1c64de58-a7fc-4478-a57d-1467e0e2b276 req-56ed01a0-7542-4322-b77e-f05499555fec service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:19.480549 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1c64de58-a7fc-4478-a57d-1467e0e2b276 req-56ed01a0-7542-4322-b77e-f05499555fec service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:19.481024 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1c64de58-a7fc-4478-a57d-1467e0e2b276 req-56ed01a0-7542-4322-b77e-f05499555fec service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:19.493831 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-1c64de58-a7fc-4478-a57d-1467e0e2b276 req-56ed01a0-7542-4322-b77e-f05499555fec service nova] Creating event network-vif-deleted:0583f15b-4997-4fe9-ac45-41bece32f59a for instance 85a39c75-450f-47b4-b540-56605b41f89d on hv-cinder-85426 Aug 29 20:23:19.500010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-1c64de58-a7fc-4478-a57d-1467e0e2b276 req-56ed01a0-7542-4322-b77e-f05499555fec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035930 Aug 29 20:23:19.500845 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 488/981] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:19.585774 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:19.594936 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-705a756a-e77d-4c90-801d-7d060b98a043 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.196405 Aug 29 20:23:19.595735 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 494/982] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:19 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:19.824823 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:19.825543 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:19.832214 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:19.832701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:19.833207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:19.833941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:19.834400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:19.834828 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:19.879515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:19.879993 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:19.880415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:19.880913 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lazy-loading 'fault' on Instance uuid 85a39c75-450f-47b4-b540-56605b41f89d {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:19.929117 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:19.938209 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aa7c2b2e-0aaf-47fa-845e-f59b143bf90a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1309 microversion: 2.1 time: 0.118877 Aug 29 20:23:19.938796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 489/983] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:19 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:20.616427 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:20.617650 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:20.624230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:20.624718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:20.625151 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:20.625880 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:20.626331 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:20.626742 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:20.762987 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:20.771049 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-803cd931-9184-47a6-927a-cdc372808c55 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.158515 Aug 29 20:23:20.771660 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 495/984] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:20 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:20.961378 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:20.962036 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:20.968457 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:20.968941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:20.969371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:20.970112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:20.970618 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:20.971077 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:21.006092 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:21.006582 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:21.007052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:21.008210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lazy-loading 'fault' on Instance uuid 85a39c75-450f-47b4-b540-56605b41f89d {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:21.056272 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:21.060494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:21.066203 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2534581a-1a32-40ef-9365-e0da3b3229c5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1309 microversion: 2.1 time: 0.109391 Aug 29 20:23:21.066784 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 490/985] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:20 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:21.793777 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:21.794407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:21.801030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:21.801514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:21.801974 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:21.802674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:21.803124 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:21.803546 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:21.947773 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:21.955619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1f5bdbfc-5ee5-4281-8ec9-40067d0e2cfc tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.166620 Aug 29 20:23:21.956204 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 496/986] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:21 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:22.089122 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:22.090058 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:22.099125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:22.099125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:22.099406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:22.100107 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:22.100810 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:22.101274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:22.136446 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:22.136934 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:22.137360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:22.137903 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lazy-loading 'fault' on Instance uuid 85a39c75-450f-47b4-b540-56605b41f89d {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:22.181670 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:22.189553 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8d8bdeef-05d7-48e4-8947-3d4e8883daea tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 200 len: 1309 microversion: 2.1 time: 0.105249 Aug 29 20:23:22.190167 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 491/987] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:22 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:22.977932 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:22.978571 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:22.985114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:22.985602 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:22.986075 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:22.986779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:22.987234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:22.987654 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:23.169307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:23.177590 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ffa90ec5-771a-4218-83ba-86ec47c51790 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.204590 Aug 29 20:23:23.178353 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 497/988] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:22 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:23.216264 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:23.217398 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 85a39c75-450f-47b4-b540-56605b41f89d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:23.227945 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:23.228564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:23.228995 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:23.229698 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:23.230182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:23.230585 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:23.248346 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] HTTP exception thrown: Instance 85a39c75-450f-47b4-b540-56605b41f89d could not be found. Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Request method failure captured: Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d HTTP/1.1 Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR_li_M9HGVQtdEbFwbSXbLZbrc7TLG48aFL7gXdq6Rpmr7W9wNuhLNx96UGXa2OMqbJf9JfhVehAhzW0hLaivfm_SKc0dK-UCukMt00xc5--DtBo1jp-x_Osq2OnCE1LR_SX-WmWWrBsGCwv-CtThZGimu-ILmZaxluH4mtWEZbn54 Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 3d6b1e6a93214e0fbe67b7dfb84f1043 Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2022608584 Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:23:23.250059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d6b1e6a93214e0fbe67b7dfb84f1043"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d6b1e6a93214e0fbe67b7dfb84f1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d6b1e6a93214e0fbe67b7dfb84f1043"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d6b1e6a93214e0fbe67b7dfb84f1043"}]}] Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesSnapshotTestJSON-2022608584 Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 3d6b1e6a93214e0fbe67b7dfb84f1043 Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2022608584 Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesSnapshotTestJSON-2022608584-project Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 47d7f801e70d4e08b73a83451fd522b1 Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesSnapshotTestJSON-2022608584-project Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 85a39c75-450f-47b4-b540-56605b41f89d could not be found. Aug 29 20:23:23.251804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '85a39c75-450f-47b4-b540-56605b41f89d'} Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a39c75-450f-47b4-b540-56605b41f89d could not be found. Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:23:23.252771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a39c75-450f-47b4-b540-56605b41f89d could not be found. Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a39c75-450f-47b4-b540-56605b41f89d could not be found. Aug 29 20:23:23.254445 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:23.255795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Returning 404 to user: Instance 85a39c75-450f-47b4-b540-56605b41f89d could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:23:23.255795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bfc16212-da58-4ea0-8706-b9b402d0fd9f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d" status: 404 len: 111 microversion: 2.1 time: 0.043439 Aug 29 20:23:23.255795 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 492/989] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:23 2022] GET /compute/v2.1/servers/85a39c75-450f-47b4-b540-56605b41f89d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:23:24.200254 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:24.200865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:24.207560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:24.208040 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:24.208471 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:24.209184 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:24.209642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:24.210067 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:24.388409 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:24.398231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c41812bc-3379-4676-a262-e93e1c0a2f2f tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.201758 Aug 29 20:23:24.398678 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 498/990] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:24 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:24.621630 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-8512507e-5055-4e2a-8d9d-3ce62104aaa5 req-9ac8d99f-ae80-4028-8e50-926207f2e220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2440bc1d-da88-474e-85cd-05ca2f4c4f45", "name": "network-vif-plugged", "status": "completed", "tag": "fc186e24-1eed-41aa-8b3e-068089cecf38"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:24.633847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8512507e-5055-4e2a-8d9d-3ce62104aaa5 req-9ac8d99f-ae80-4028-8e50-926207f2e220 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:24.634393 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8512507e-5055-4e2a-8d9d-3ce62104aaa5 req-9ac8d99f-ae80-4028-8e50-926207f2e220 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:24.634839 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8512507e-5055-4e2a-8d9d-3ce62104aaa5 req-9ac8d99f-ae80-4028-8e50-926207f2e220 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:24.647349 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-8512507e-5055-4e2a-8d9d-3ce62104aaa5 req-9ac8d99f-ae80-4028-8e50-926207f2e220 service nova] Creating event network-vif-plugged:fc186e24-1eed-41aa-8b3e-068089cecf38 for instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 on hv-cinder-85426 Aug 29 20:23:24.652937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-8512507e-5055-4e2a-8d9d-3ce62104aaa5 req-9ac8d99f-ae80-4028-8e50-926207f2e220 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036563 Aug 29 20:23:24.653550 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 493/991] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:25.423662 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:25.424548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:25.432129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:25.432947 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:25.433913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.434851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:25.435069 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:25.435560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.462976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "708581b5-2206-4f3f-96bf-134877343710"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:25.465512 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:25.473465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:25.474082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:25.474592 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.475368 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:25.476383 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:25.476919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.576662 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Invalid volume: volume 708581b5-2206-4f3f-96bf-134877343710 is already attached to instances: 7c9edd36-10af-43d8-ba3c-8232ef5809af Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: POST /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments HTTP/1.1 Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 74 Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:23:25.578423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {"volumeAttachment": {"volumeId": "708581b5-2206-4f3f-96bf-134877343710"}} Aug 29 20:23:25.580355 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Invalid volume: volume 708581b5-2206-4f3f-96bf-134877343710 is already attached to instances: 7c9edd36-10af-43d8-ba3c-8232ef5809af Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'server_id': '7c9edd36-10af-43d8-ba3c-8232ef5809af', 'body': {'volumeAttachment': {'volumeId': '708581b5-2206-4f3f-96bf-134877343710'}}} Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 708581b5-2206-4f3f-96bf-134877343710 is already attached to instances: 7c9edd36-10af-43d8-ba3c-8232ef5809af Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:25.582217 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 708581b5-2206-4f3f-96bf-134877343710 is already attached to instances: 7c9edd36-10af-43d8-ba3c-8232ef5809af Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:25.585497 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:25.588910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:25.588910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:23:25.588910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:23:25.588910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 708581b5-2206-4f3f-96bf-134877343710 is already attached to instances: 7c9edd36-10af-43d8-ba3c-8232ef5809af Aug 29 20:23:25.588910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:25.588910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 400 to user: Invalid volume: volume 708581b5-2206-4f3f-96bf-134877343710 is already attached to instances: 7c9edd36-10af-43d8-ba3c-8232ef5809af {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:23:25.588910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9614c336-eb53-48b1-b7eb-1c0f56e73ccf tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122642 Aug 29 20:23:25.588910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 494/992] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:23:25 2022] POST /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:23:25.595475 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:25.604141 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-da73a16f-f452-4968-8bff-a29978055aca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.184838 Aug 29 20:23:25.604710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 499/993] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:25 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:25.660626 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:25.661223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:25.669851 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:25.670539 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:25.671120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.671910 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:25.672371 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:25.672796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.761050 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lazy-loading 'services' on Instance uuid 7c9edd36-10af-43d8-ba3c-8232ef5809af {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:25.838525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e503282c-a9be-45ef-9144-e8a7102803ad tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments/708581b5-2206-4f3f-96bf-134877343710" status: 202 len: 0 microversion: 2.1 time: 0.181641 Aug 29 20:23:25.839112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 495/994] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:23:25 2022] DELETE /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments/708581b5-2206-4f3f-96bf-134877343710 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:23:25.848078 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:25.850274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:25.857015 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:25.857496 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:25.857966 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.858670 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:25.859112 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:25.859528 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.863737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:25.900627 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-95913188-8728-44ed-8778-81e294899d34 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056777 Aug 29 20:23:25.901307 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 500/995] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:23:25 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:26.633178 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:26.633945 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:26.640894 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:26.641367 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:26.641827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:26.642530 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:26.642964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:26.643370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:26.777351 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:26.784999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f0ed6f4d-0cec-4577-96f0-28bd6974049e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.156161 Aug 29 20:23:26.785551 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 496/996] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:26 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:26.914371 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:26.916510 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:26.923176 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:26.923661 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:26.924090 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:26.924788 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:26.925235 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:26.925653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:26.956856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-554d741f-add7-4d0c-b000-f71a8069217d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Aug 29 20:23:26.957440 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 501/997] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:23:26 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:27.807280 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:27.807899 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:27.814577 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:27.815061 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:27.815494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:27.816193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:27.816646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:27.817069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:27.965951 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:27.968736 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:27.971124 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:27.974112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-da2b1b44-dcb5-416f-acbb-8c7fdd3e98f5 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.170978 Aug 29 20:23:27.974774 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 497/998] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:27 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:27.978575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:27.979124 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:27.979611 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:27.980324 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:27.980794 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:27.981199 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:28.013319 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b123af3d-f29e-4626-9c3e-921c127112c0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048563 Aug 29 20:23:28.013919 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 502/999] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:23:27 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:28.997584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:28.998440 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:29.007200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:29.007690 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:29.008124 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:29.008874 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:29.009369 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:29.009824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:29.027530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:29.030680 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:29.039253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:29.039740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:29.040468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:29.041558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:29.042094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:29.042816 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:29.086775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bc3f1420-56f2-456d-a820-b4c961ac174d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064485 Aug 29 20:23:29.088013 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 503/1000] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:23:29 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:29.195459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:29.208889 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4410e481-b1b8-4b5a-8c80-df18a21194ca tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1359 microversion: 2.1 time: 0.214969 Aug 29 20:23:29.210347 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 498/1001] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:28 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:30.105325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:30.108255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:30.118472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.119025 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.119456 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.120367 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.120909 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.121477 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.168208 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bd55d0e3-46c2-4c6a-885c-45cacebb9715 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069845 Aug 29 20:23:30.168954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 504/1002] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:23:30 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:30.240330 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:30.242062 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:30.250126 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.250637 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.251039 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.251760 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.252200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.252618 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.417848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:30.426173 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-687f5098-4b34-4e75-8e61-761eed9958d1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1549 microversion: 2.1 time: 0.189668 Aug 29 20:23:30.427081 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 499/1003] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:30 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1549 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:30.450580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:30.451289 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:30.458303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.459807 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.460778 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.461730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.462317 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.462865 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.644449 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:30.654311 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-81bce446-b5f1-4c51-a67a-3ee58de0d061 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1549 microversion: 2.1 time: 0.206994 Aug 29 20:23:30.654776 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 505/1004] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:30 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1549 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:30.684010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:30.691063 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:30.691990 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Searching by: {'deleted': False, 'project_id': '9f9f5a2386e2451f9a9b833859343595'} {{(pid=120788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 20:23:30.692219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-118492928", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-220491953", "security_groups": [{"name": "tempest-secgroup-smoke-1427790051"}], "block_device_mapping_v2": [{"uuid": "13775dd8-acf4-4f90-b192-f775e4072e8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d909eff5-27cf-4d36-886a-2daf13a96ae0"}]}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:30.700702 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.701321 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.701936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.702767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.703315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.703923 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.823738 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.multi_cell_list [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 20:23:30.849738 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] validate_networks() for [('d909eff5-27cf-4d36-886a-2daf13a96ae0', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:23:30.956882 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-86b595c4-b446-4b75-8e36-58efc806cf98 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.277190 Aug 29 20:23:30.957370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 500/1005] 10.222.0.73 () {58 vars in 1125 bytes} [Mon Aug 29 20:23:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:30.970597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:30.971311 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:30.977967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.978444 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.979092 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.980057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.980513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.980937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:31.220538 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:31.230810 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-27dd3db6-6962-49df-8c9f-cb3f87d8bcd7 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1549 microversion: 2.1 time: 0.264399 Aug 29 20:23:31.231390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 501/1006] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:30 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1549 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:31.236659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:31.239435 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:31.241444 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:31.251103 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:31.251730 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:31.252360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:31.253582 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:31.254206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:31.254791 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:31.316480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ecb7422b-2b9e-4220-9073-a083ac661df6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082840 Aug 29 20:23:31.317911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 502/1007] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:23:31 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:31.615017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:23:31.616947 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:23:31.617979 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:23:31.618764 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:23:31.620325 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:23:31.623253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:31.635636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:31.636608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:31.637437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:31.638682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:31.639518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:31.640082 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:31.670255 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Getting quotas for project ff3969ffe8ff411b8773e1f3f3cb0b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:23:31.677391 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Getting quotas for user 8640600ca0d745cda547a1027c947089 and project ff3969ffe8ff411b8773e1f3f3cb0b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:23:31.754563 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:23:31.758969 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13775dd8-acf4-4f90-b192-f775e4072e8c',volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:23:31.982623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dc22f61f-70d7-41c9-96c5-2a9d2752c57c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.295223 Aug 29 20:23:31.993824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 506/1008] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:23:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:23:32.005645 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e1cb603c-447b-4a57-9501-54a190686ca4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:32.007198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e1cb603c-447b-4a57-9501-54a190686ca4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:32.079700 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e1cb603c-447b-4a57-9501-54a190686ca4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:32.091967 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e1cb603c-447b-4a57-9501-54a190686ca4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1093 microversion: 2.1 time: 0.095251 Aug 29 20:23:32.092929 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 503/1009] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:31 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1093 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:32.335783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:32.340239 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:32.354244 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:32.355134 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:32.355959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:32.357197 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:32.358057 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:32.358834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:32.414834 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-2fc13709-11d8-4a4c-b5be-c1e39482ed27 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085597 Aug 29 20:23:32.415866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 507/1010] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:23:32 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:23:32.708834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:32.710728 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:32.720778 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:32.721613 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:32.722393 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:32.723714 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:32.724475 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:32.725776 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:32.770516 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:23:32.858345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b0f8fd95-9cf7-4819-aae6-f3750b4e116c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 204 len: 0 microversion: 2.1 time: 0.154244 Aug 29 20:23:32.859081 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 504/1011] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:23:32 2022] DELETE /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:23:32.869098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:32.869875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:32.879016 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:32.879799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:32.880515 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:32.882262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:32.883426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:32.884362 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:33.045452 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:33.056925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-5247055f-4f31-4df3-ad81-d9c8edaadc36 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1680 microversion: 2.1 time: 0.192399 Aug 29 20:23:33.057970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 508/1012] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:32 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:33.116163 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:33.116939 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:33.123927 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:33.124547 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:33.125185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:33.126187 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:33.126683 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:33.127156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:33.193545 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:33.201836 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4a0ea910-972e-4df7-baad-24bc835b90ca tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1143 microversion: 2.1 time: 0.091095 Aug 29 20:23:33.202513 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 505/1013] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:33 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:34.091761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:34.092779 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:34.104164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:34.104952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:34.105659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:34.106839 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:34.107609 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:34.108298 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:34.228224 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:34.229873 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:34.240682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:34.241519 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:34.242299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:34.245145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:34.246020 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:34.246825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:34.308098 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:34.321436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e8eceee7-63e7-4c45-94b2-32dde36d69b6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1680 microversion: 2.1 time: 0.236291 Aug 29 20:23:34.322095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 509/1014] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:34 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:34.351043 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:34.355248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:34.362946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4b8cf1f7-8c26-4d8f-a7b3-87bdffcc9d8d tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1143 microversion: 2.1 time: 0.142327 Aug 29 20:23:34.363707 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 506/1015] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:34 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1143 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:35.358557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:35.359569 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:35.371575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:35.372440 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:35.373232 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:35.374369 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:35.375019 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:35.375511 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:35.392646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:35.393402 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:35.403878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:35.404435 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:35.404973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:35.405852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:35.406462 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:35.407038 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:35.490722 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:35.506480 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5a6973c9-aaaf-4201-a9cd-57e3f0de4511 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1135 microversion: 2.1 time: 0.117888 Aug 29 20:23:35.507274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 507/1016] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:35 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1135 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:35.573209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:35.583239 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-567b9688-f1b5-43e5-9031-2c3a71ff5e1e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1680 microversion: 2.1 time: 0.231233 Aug 29 20:23:35.587378 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 510/1017] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:35 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:35.881815 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-429942691", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "networks": [{"uuid": "e9c72865-bd63-4803-99cb-49e75af2456f"}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:35.950576 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] validate_networks() for [('e9c72865-bd63-4803-99cb-49e75af2456f', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:23:36.455279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31b4cc52-ec89-42ab-8c49-3b9b536757b5"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:36.460356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:36.468488 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:36.469061 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:36.469697 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:36.470434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:36.470930 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:36.471408 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:36.492345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:23:36.492847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:23:36.493207 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:23:36.493602 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:23:36.494026 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:23:36.514617 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:36.515411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:36.516066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:36.517178 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:36.518265 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:36.518735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:36.544293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Getting quotas for project 3d6b1e6a93214e0fbe67b7dfb84f1043. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:23:36.548821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Getting quotas for user 47d7f801e70d4e08b73a83451fd522b1 and project 3d6b1e6a93214e0fbe67b7dfb84f1043. Resources: {'cores', 'instances', 'ram'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:23:36.563375 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:23:36.565643 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:23:36.643554 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aeb57413-7a57-4f63-be1d-21a6e3dbf1ff tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766415 Aug 29 20:23:36.644726 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 508/1018] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:23:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:23:36.650722 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:36.651390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:36.663879 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:36.665069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:36.667639 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:36.667639 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:36.667639 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:36.668315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:36.769273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:36.783652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-92348a4d-6381-45d9-b42b-c8eab75c22fc tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1135 microversion: 2.1 time: 0.137749 Aug 29 20:23:36.784507 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 509/1019] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:36 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1135 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:36.792588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:36.793219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:36.803151 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:36.803885 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:36.804536 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:36.805617 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:36.806386 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:36.807030 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:37.078181 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:37.116296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c469450c-b12f-4436-abcf-20e4c77cfbf3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1680 microversion: 2.1 time: 0.329754 Aug 29 20:23:37.121819 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 510/1020] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:36 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:37.136148 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-555dbbc1-fff7-4a1c-9f72-afdf03cc0f5f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:37.137842 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-555dbbc1-fff7-4a1c-9f72-afdf03cc0f5f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:37.253196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-555dbbc1-fff7-4a1c-9f72-afdf03cc0f5f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:37.265077 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-24c724b1-7572-475b-84fa-98933c66aa76 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "POST /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814240 Aug 29 20:23:37.267053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 511/1021] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:23:36 2022] POST /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:37.298961 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-555dbbc1-fff7-4a1c-9f72-afdf03cc0f5f tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1218 microversion: 2.1 time: 0.166898 Aug 29 20:23:37.306469 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 511/1022] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:37 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:37.821326 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:37.822765 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:37.832665 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:37.833462 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:37.834204 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:37.835246 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:37.835959 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:37.836572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:37.969275 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:37.982271 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ddc0c02b-2f8e-4b6c-9819-04b487c5a950 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1191 microversion: 2.1 time: 0.167962 Aug 29 20:23:37.982271 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 512/1023] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:37 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1191 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:38.161225 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:38.162756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:38.172936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.173954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.174901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.178150 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.179640 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.180925 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.346715 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:38.354359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:38.356123 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:38.365064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-46230b50-1466-4f9c-8da8-a4aaadf12cd0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1613 microversion: 2.1 time: 0.209968 Aug 29 20:23:38.366064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 512/1024] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:38 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1613 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:38.374034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.375226 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.375954 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.377577 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.378791 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.379567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.595863 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:38.611336 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c63d910c-ff44-4efe-a478-51f000deb2b0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1270 microversion: 2.1 time: 0.269580 Aug 29 20:23:38.612761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 513/1025] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:38 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:39.035207 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:39.036576 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:39.050574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.054704 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.055868 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.057495 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.059849 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.060699 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.126713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-f3c0de01-d7c1-47d1-a46c-08bdcd4d5fe4 req-09d8ceb8-bba5-42d0-b1dd-a52ed58e6b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9edd36-10af-43d8-ba3c-8232ef5809af", "name": "network-vif-deleted", "tag": "a9f4fe55-978c-4d8b-8bbb-d7b16d8e707b"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:39.141684 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f3c0de01-d7c1-47d1-a46c-08bdcd4d5fe4 req-09d8ceb8-bba5-42d0-b1dd-a52ed58e6b3e service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.142952 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f3c0de01-d7c1-47d1-a46c-08bdcd4d5fe4 req-09d8ceb8-bba5-42d0-b1dd-a52ed58e6b3e service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.144195 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f3c0de01-d7c1-47d1-a46c-08bdcd4d5fe4 req-09d8ceb8-bba5-42d0-b1dd-a52ed58e6b3e service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.193219 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-f3c0de01-d7c1-47d1-a46c-08bdcd4d5fe4 req-09d8ceb8-bba5-42d0-b1dd-a52ed58e6b3e service nova] Creating event network-vif-deleted:a9f4fe55-978c-4d8b-8bbb-d7b16d8e707b for instance 7c9edd36-10af-43d8-ba3c-8232ef5809af on hv-cinder-85426 Aug 29 20:23:39.208632 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-f3c0de01-d7c1-47d1-a46c-08bdcd4d5fe4 req-09d8ceb8-bba5-42d0-b1dd-a52ed58e6b3e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220769 Aug 29 20:23:39.212407 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 513/1026] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:39.214690 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:39.230917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6506728e-2d60-4948-aa34-f2abef38f2a5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1209 microversion: 2.1 time: 0.217898 Aug 29 20:23:39.232327 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 514/1027] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:39 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1209 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:39.413020 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:39.415064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:39.427070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.427814 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.428501 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.429902 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.431101 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.432038 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.646748 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:39.650175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:39.707107 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.709611 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.712193 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:39.713374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.715478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.720499 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.721531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.732845 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-71b0dc20-22f7-4935-8bb6-6b92ddcc7572 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1326 microversion: 2.1 time: 0.333871 Aug 29 20:23:39.741380 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 514/1028] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:39 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1326 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:39.886231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:39.901890 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f43d4b1a-733d-4c57-a27f-83275dc8b6d0 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1276 microversion: 2.1 time: 0.263139 Aug 29 20:23:39.903000 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 515/1029] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:39 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1276 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:40.277064 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:40.279037 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:40.290905 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.293653 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.294695 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:40.296343 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.297677 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.298669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:40.551061 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:40.566253 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-659b3122-b83d-4da0-9491-b01d7d8379e2 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1277 microversion: 2.1 time: 0.295938 Aug 29 20:23:40.568800 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 515/1030] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:40 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1277 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:40.763877 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:40.768415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:40.810392 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.811872 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.821231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:40.822966 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.823518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.824182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:40.842514 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:40.945149 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.945938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.946610 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:40.949398 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lazy-loading 'fault' on Instance uuid 7c9edd36-10af-43d8-ba3c-8232ef5809af {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:40.978004 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:40.979558 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:41.002824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:41.003672 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:41.005186 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:41.007090 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:41.008145 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:41.009052 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:41.060831 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:41.073306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a1ceb28a-be6b-46fc-8781-405478e30275 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 200 len: 1331 microversion: 2.1 time: 0.316793 Aug 29 20:23:41.078645 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 516/1031] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:40 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 1331 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:41.371994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:41.385523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-78e13502-38a9-408d-a2b5-5e81c4083006 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1318 microversion: 2.1 time: 0.451843 Aug 29 20:23:41.386700 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 516/1032] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:40 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:41.600457 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:41.601393 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:41.612886 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:41.614613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:41.615592 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:41.617557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:41.618294 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:41.618926 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:41.655901 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:41.686478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=6 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:41.986916 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:42.003031 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f5b123de-9fa0-4c82-a344-ed2a60beff31 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1277 microversion: 2.1 time: 0.411793 Aug 29 20:23:42.005008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 517/1033] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:41 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1277 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:42.030826 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-b100d5a1-64f3-47c6-9ad5-cad9d51e042a req-6abb4e6f-6ef1-4749-b76d-19dbcd464775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0", "tag": "83c4727c-dd32-4e08-9379-33b1f266216a"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:42.048626 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b100d5a1-64f3-47c6-9ad5-cad9d51e042a req-6abb4e6f-6ef1-4749-b76d-19dbcd464775 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.049166 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b100d5a1-64f3-47c6-9ad5-cad9d51e042a req-6abb4e6f-6ef1-4749-b76d-19dbcd464775 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.049745 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b100d5a1-64f3-47c6-9ad5-cad9d51e042a req-6abb4e6f-6ef1-4749-b76d-19dbcd464775 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.062799 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-41f831cb-c7f1-43f6-8dd4-07fa224fc0c9 req-26ed6fec-3905-4b66-81a4-80d3b0931f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b3178e-cab8-4084-9853-7f2158716f4a", "tag": "6185c796-fc55-418e-a57e-a35ddb233dfa"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:42.071416 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-b100d5a1-64f3-47c6-9ad5-cad9d51e042a req-6abb4e6f-6ef1-4749-b76d-19dbcd464775 service nova] Creating event network-changed:83c4727c-dd32-4e08-9379-33b1f266216a for instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 on hv-cinder-85426 Aug 29 20:23:42.081491 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-b100d5a1-64f3-47c6-9ad5-cad9d51e042a req-6abb4e6f-6ef1-4749-b76d-19dbcd464775 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226056 Aug 29 20:23:42.082205 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 517/1034] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:42.093322 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-41f831cb-c7f1-43f6-8dd4-07fa224fc0c9 req-26ed6fec-3905-4b66-81a4-80d3b0931f8d service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.094356 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-41f831cb-c7f1-43f6-8dd4-07fa224fc0c9 req-26ed6fec-3905-4b66-81a4-80d3b0931f8d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.095312 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-41f831cb-c7f1-43f6-8dd4-07fa224fc0c9 req-26ed6fec-3905-4b66-81a4-80d3b0931f8d service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.114633 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:42.115681 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:42.120215 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-41f831cb-c7f1-43f6-8dd4-07fa224fc0c9 req-26ed6fec-3905-4b66-81a4-80d3b0931f8d service nova] Creating event network-changed:6185c796-fc55-418e-a57e-a35ddb233dfa for instance 70b3178e-cab8-4084-9853-7f2158716f4a on hv-cinder-85426 Aug 29 20:23:42.126067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.126067 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.126705 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.127592 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.128221 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.128732 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.129358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-41f831cb-c7f1-43f6-8dd4-07fa224fc0c9 req-26ed6fec-3905-4b66-81a4-80d3b0931f8d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071793 Aug 29 20:23:42.131766 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 518/1035] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:42.153255 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af HTTP/1.1 Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:23:42.155787 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:23:42.158486 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '7c9edd36-10af-43d8-ba3c-8232ef5809af'} Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:23:42.159612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:23:42.162366 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:23:42.164159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:23:42.164159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6e654793-6c07-4bd8-a68a-4c9c49ed04ea tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 404 len: 111 microversion: 2.1 time: 0.050809 Aug 29 20:23:42.164159 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 518/1036] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:42 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:23:42.171912 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-753a5b59-f203-4793-baf5-609abe615560 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '.version_select at 0x7f15f9f07d30>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:42.199231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-753a5b59-f203-4793-baf5-609abe615560 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-969584900" status: 202 len: 0 microversion: 2.1 time: 0.032438 Aug 29 20:23:42.200026 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 519/1037] 10.222.0.73 () {58 vars in 1218 bytes} [Mon Aug 29 20:23:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-969584900 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:23:42.418941 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:42.421489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:42.433949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.435378 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.436414 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.438073 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.439176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.440200 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.749347 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:42.773179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ba121e96-af4c-40e6-90b0-5a86bb886359 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1318 microversion: 2.1 time: 0.360278 Aug 29 20:23:42.773919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 519/1038] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:42 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:43.035219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:43.040451 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:43.046518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.048081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.048788 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.049595 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.050322 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.051033 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.341028 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:43.350765 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e35fb35c-c957-49dc-84d1-ba9ce4ed2ae4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1277 microversion: 2.1 time: 0.321631 Aug 29 20:23:43.351986 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 520/1039] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:43 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:43.408354 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a3a85f1c-7f31-4e9b-b614-d1a3e534b6c9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: .version_select at 0x7f15f9db90d0>, body: {"keypair": {"name": "tempest-keypair-1534733868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFlQ6XNgUS2RoFW/SQ+JMrodQ0MbtT2SiCNqDjTrclJLiyyDqQLk6vanR+eVF966aOaEr1DMLciLK5vbrYSGZFmXa/SNoMTS0fYyDA6L6lmeF58UoWmHTCVM+NaBlVD2A=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:43.429191 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-a3a85f1c-7f31-4e9b-b614-d1a3e534b6c9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:23:43.433821 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-a3a85f1c-7f31-4e9b-b614-d1a3e534b6c9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for user c7c8422c3d314adca25acf967ffd0998 and project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:23:43.460566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a3a85f1c-7f31-4e9b-b614-d1a3e534b6c9 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056855 Aug 29 20:23:43.461968 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 520/1040] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Aug 29 20:23:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:43.799206 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:43.800252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:43.815012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.815619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.816274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.817412 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.818161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.818798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.148608 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:44.167925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bbfc012a-f1ab-430d-9f88-356de233e73d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1318 microversion: 2.1 time: 0.374180 Aug 29 20:23:44.177738 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 521/1041] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:43 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:44.386459 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:44.387230 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:44.396463 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.397110 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.397683 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.398581 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.399359 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.400069 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.602528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:44.615269 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-938d9445-6623-4712-9f2f-74ee7f246d00 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1277 microversion: 2.1 time: 0.232875 Aug 29 20:23:44.616137 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 521/1042] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:44 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:45.209643 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:45.221278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:45.231809 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:45.232645 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:45.233657 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:45.234922 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:45.235629 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:45.236591 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:45.566092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:45.578377 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-aff2eabe-73d7-4f80-9920-56d54dce5c8b tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1318 microversion: 2.1 time: 0.379897 Aug 29 20:23:45.579371 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 522/1043] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:45 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:45.640428 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:45.641390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:45.649311 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:45.649853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:45.650289 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:45.651013 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:45.651463 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:45.651883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:45.931346 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:45.940156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b4cd4526-00cd-4300-988d-1f8f6315a335 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1277 microversion: 2.1 time: 0.304593 Aug 29 20:23:45.940739 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 522/1044] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:45 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1277 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:45.967267 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-145235930", "imageRef": "c0a342c8-60cd-4126-b923-0fe3e21a5602", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68f99afd-3890-4bbb-ac8f-4e5af64abbb6"}], "security_groups": [{"name": "tempest-securitygroup--1094040010"}], "key_name": "tempest-keypair-1534733868", "user_data": "}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:46.141575 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.network.neutron [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] validate_networks() for [('68f99afd-3890-4bbb-ac8f-4e5af64abbb6', None, None, None, None, None)] {{(pid=120787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:23:46.611406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:46.611927 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:46.618226 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:46.625023 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.625917 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.626680 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.627853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.629245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.630035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.780752 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Flavor limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:23:46.781472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Image limits 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:23:46.781656 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Flavor pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:23:46.782148 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Image pref 0:0:0 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:23:46.783299 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.virt.hardware [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:23:46.794773 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.795724 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.796359 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.797263 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.797965 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.798564 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.834157 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:46.841895 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:23:46.844045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-07151d34-137e-4dcc-8166-e1133b4b7aa1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1595 microversion: 2.1 time: 0.239255 Aug 29 20:23:46.844858 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 523/1045] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:46 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1595 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:46.852345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:46.852966 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:46.862558 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.quota [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Getting quotas for user c7c8422c3d314adca25acf967ffd0998 and project 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:23:46.868825 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.869657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.870241 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.879552 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.880693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.881455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.896469 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Going to run 1 instances... {{(pid=120787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:23:46.899426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0a342c8-60cd-4126-b923-0fe3e21a5602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:23:46.967532 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-79b46793-5754-4b2b-b062-8af8f4870333 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.003943 Aug 29 20:23:46.975745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 523/1046] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 29 20:23:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:23:46.978506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:46.979737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:46.993580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.994179 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.994693 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.995474 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.996000 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.996493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:47.180993 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:47.202167 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1b41b438-b3d1-47b6-a78e-c83a37648e56 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1318 microversion: 2.1 time: 0.355488 Aug 29 20:23:47.203438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 524/1047] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:46 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:47.210470 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e37db0ec-a4eb-4734-8b0c-ae730a9ced1c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:47.211646 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e37db0ec-a4eb-4734-8b0c-ae730a9ced1c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:47.278801 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:47.296333 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-0e08aa25-8c35-4b09-b11b-c5ee0a3162d4 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.325605 Aug 29 20:23:47.313700 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 524/1048] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:46 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:47.316489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e37db0ec-a4eb-4734-8b0c-ae730a9ced1c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:47.333362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e37db0ec-a4eb-4734-8b0c-ae730a9ced1c tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1241 microversion: 2.1 time: 0.127271 Aug 29 20:23:47.348574 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 525/1049] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:47 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1241 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:48.226539 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:48.227095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:48.234762 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.235567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.236316 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:48.237532 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.238395 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.239151 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:48.321491 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:48.322312 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:48.333852 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.334426 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.337987 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:48.339430 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.340098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.340536 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:48.393840 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:48.415234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ec5a6cd3-2af8-470b-b936-7d65d08ce298 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1318 microversion: 2.1 time: 0.193716 Aug 29 20:23:48.415839 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 525/1050] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:48 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:48.421256 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:48.421913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:48.434252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.434833 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.435496 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:48.436305 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.436842 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.437336 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:48.512424 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:48.523531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-46fd50e0-b483-412f-9ffe-9e8603a3cf0e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1293 microversion: 2.1 time: 0.106636 Aug 29 20:23:48.524929 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 526/1051] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:48 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:48.603504 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:48.618758 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2df3035b-9201-449a-ba17-60c9d10b85b5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.301310 Aug 29 20:23:48.619348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 526/1052] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:48 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:48.805053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-050d6c83-e223-4e78-a760-d600f3165c02 req-9458faa2-328a-4161-a247-6e5254c2cbff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b3178e-cab8-4084-9853-7f2158716f4a", "name": "network-vif-plugged", "status": "completed", "tag": "6185c796-fc55-418e-a57e-a35ddb233dfa"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:48.815443 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-050d6c83-e223-4e78-a760-d600f3165c02 req-9458faa2-328a-4161-a247-6e5254c2cbff service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.817058 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-050d6c83-e223-4e78-a760-d600f3165c02 req-9458faa2-328a-4161-a247-6e5254c2cbff service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.817680 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-050d6c83-e223-4e78-a760-d600f3165c02 req-9458faa2-328a-4161-a247-6e5254c2cbff service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:48.842364 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-050d6c83-e223-4e78-a760-d600f3165c02 req-9458faa2-328a-4161-a247-6e5254c2cbff service nova] Creating event network-vif-plugged:6185c796-fc55-418e-a57e-a35ddb233dfa for instance 70b3178e-cab8-4084-9853-7f2158716f4a on hv-cinder-85426 Aug 29 20:23:48.848574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-050d6c83-e223-4e78-a760-d600f3165c02 req-9458faa2-328a-4161-a247-6e5254c2cbff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129024 Aug 29 20:23:48.849759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 527/1053] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:49.421796 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-8190f32a-5cb2-41c5-8a01-bed78be1041e req-3ec033c2-7c86-41dd-a1cc-dbb39af032a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2440bc1d-da88-474e-85cd-05ca2f4c4f45", "tag": "fc186e24-1eed-41aa-8b3e-068089cecf38"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:49.446505 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:49.450314 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:49.478755 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8190f32a-5cb2-41c5-8a01-bed78be1041e req-3ec033c2-7c86-41dd-a1cc-dbb39af032a2 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:49.481523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8190f32a-5cb2-41c5-8a01-bed78be1041e req-3ec033c2-7c86-41dd-a1cc-dbb39af032a2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:49.484456 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8190f32a-5cb2-41c5-8a01-bed78be1041e req-3ec033c2-7c86-41dd-a1cc-dbb39af032a2 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:49.485044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:49.486946 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:49.488743 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:49.491324 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:49.492446 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:49.493470 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:49.523863 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-8190f32a-5cb2-41c5-8a01-bed78be1041e req-3ec033c2-7c86-41dd-a1cc-dbb39af032a2 service nova] Creating event network-changed:fc186e24-1eed-41aa-8b3e-068089cecf38 for instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 on hv-cinder-85426 Aug 29 20:23:49.530245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-8190f32a-5cb2-41c5-8a01-bed78be1041e req-3ec033c2-7c86-41dd-a1cc-dbb39af032a2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130480 Aug 29 20:23:49.531537 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 527/1054] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:49.555017 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:49.557679 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:49.570183 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:49.570767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:49.571807 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:49.572641 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:49.573158 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:49.573818 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:49.900772 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:49.914014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-c3b7f674-ce32-428c-9672-0d0ab9bdfb68 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1318 microversion: 2.1 time: 0.480049 Aug 29 20:23:49.914613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 528/1055] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:49 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:49.934423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:49.935435 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:49.941515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:49.946423 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:49.952324 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:49.953182 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:49.954906 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:49.956036 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:49.956721 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:49.957804 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-beb815b0-118f-4483-a0d8-7d1d0558938d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.411858 Aug 29 20:23:49.969059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 528/1056] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:49 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:50.250580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:50.271400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-30d5c14c-2e87-426e-a3cf-21f45060d6a3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.355165 Aug 29 20:23:50.273231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 529/1057] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:49 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:50.946911 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:50.948123 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:50.961221 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:50.963667 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:50.964309 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:50.965431 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:50.967065 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:50.967836 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:50.991868 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:50.992560 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:51.006628 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.006628 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.008221 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.010190 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.010675 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.012481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.201127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:51.204856 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:51.212283 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-57a4d345-ad8b-4101-9065-63883deb4471 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1508 microversion: 2.1 time: 0.272266 Aug 29 20:23:51.214198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 529/1058] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:50 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:51.219469 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-86bd7e33-4f6d-4300-b235-52e0a838c8c8 req-d39886f8-8a06-4fe5-ac31-14895803175a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb00efd8-9531-4c67-a87a-7674b3bd7fe4", "tag": "383776ed-a60d-4566-92b4-4d7d1b6ee46c"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:51.230082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-86bd7e33-4f6d-4300-b235-52e0a838c8c8 req-d39886f8-8a06-4fe5-ac31-14895803175a service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.230818 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-86bd7e33-4f6d-4300-b235-52e0a838c8c8 req-d39886f8-8a06-4fe5-ac31-14895803175a service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.231435 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-86bd7e33-4f6d-4300-b235-52e0a838c8c8 req-d39886f8-8a06-4fe5-ac31-14895803175a service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.247093 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-86bd7e33-4f6d-4300-b235-52e0a838c8c8 req-d39886f8-8a06-4fe5-ac31-14895803175a service nova] Creating event network-changed:383776ed-a60d-4566-92b4-4d7d1b6ee46c for instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 on hv-cinder-85426 Aug 29 20:23:51.253570 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-86bd7e33-4f6d-4300-b235-52e0a838c8c8 req-d39886f8-8a06-4fe5-ac31-14895803175a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037209 Aug 29 20:23:51.255043 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 530/1059] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:51.261682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0894d7e5-1227-4762-8412-0fe5c47d73d2", "device": "/dev/sdb"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:51.266541 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:51.276396 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.277224 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.277943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.279166 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.280254 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.281189 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.355942 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:51.371116 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-fefbe065-6286-47f0-9d1a-1db0746ec7d3 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.384378 Aug 29 20:23:51.374030 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 530/1060] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:50 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:51.382351 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:51.383670 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:51.392685 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.394843 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.395387 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.397300 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.397517 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.398352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.644910 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:51.656259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1459afc6-52f0-44d1-9101-b7836091a80a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.279131 Aug 29 20:23:51.670346 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 531/1061] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:51 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:51.780485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6937a5fd-8ffe-4140-b068-af5f77dbb213 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "POST /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523276 Aug 29 20:23:51.782245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 531/1062] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:23:51 2022] POST /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:51.812568 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-489003092"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:51.813825 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:51.834431 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.835829 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.836831 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.838306 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.839436 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.840402 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.052054 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.network.security_group_api [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Adding security group 42c809db-d3ae-4ce7-b504-c65e2d6a2566 to port fc186e24-1eed-41aa-8b3e-068089cecf38 Aug 29 20:23:52.396776 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:52.397466 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:52.405678 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:52.406379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:52.406788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.407628 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:52.408113 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:52.408622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.582694 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:52.591922 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a9dfd81a-5edf-4b8f-9fb9-1d2f91960ed7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.200502 Aug 29 20:23:52.593296 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 532/1063] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:52 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:52.634154 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e26e282d-eaa7-4011-8e82-0ebb6af1aa6c tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "POST /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/action" status: 202 len: 0 microversion: 2.1 time: 0.838122 Aug 29 20:23:52.634783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 532/1064] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:23:51 2022] POST /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/action => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:23:52.646846 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:52.647453 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:52.654022 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:52.654509 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:52.654951 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.655705 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:52.656241 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:52.656609 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.681832 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:52.683274 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:52.696242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:52.697544 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:52.698564 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.699698 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:52.700848 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:52.701867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.949854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:52.960772 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7b7421d1-ba08-48de-97a0-eefeecb86493 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1759 microversion: 2.1 time: 0.319315 Aug 29 20:23:52.961354 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 533/1065] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:52 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1759 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:52.964520 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:52.978831 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-1e505224-22b6-42e7-8a25-3cf665470dfd tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.302286 Aug 29 20:23:52.979955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 533/1066] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:52 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:53.278245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-983b3bc4-46a8-4ceb-aed8-806cffd0aa9b req-f6c189a7-3ba8-4a29-a4ed-6879798a8a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2440bc1d-da88-474e-85cd-05ca2f4c4f45", "tag": "fc186e24-1eed-41aa-8b3e-068089cecf38"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:53.284638 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:53.291478 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-983b3bc4-46a8-4ceb-aed8-806cffd0aa9b req-f6c189a7-3ba8-4a29-a4ed-6879798a8a71 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:53.292040 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-983b3bc4-46a8-4ceb-aed8-806cffd0aa9b req-f6c189a7-3ba8-4a29-a4ed-6879798a8a71 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:53.292534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-983b3bc4-46a8-4ceb-aed8-806cffd0aa9b req-f6c189a7-3ba8-4a29-a4ed-6879798a8a71 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:53.308019 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-983b3bc4-46a8-4ceb-aed8-806cffd0aa9b req-f6c189a7-3ba8-4a29-a4ed-6879798a8a71 service nova] Creating event network-changed:fc186e24-1eed-41aa-8b3e-068089cecf38 for instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 on hv-cinder-85426 Aug 29 20:23:53.313133 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-983b3bc4-46a8-4ceb-aed8-806cffd0aa9b req-f6c189a7-3ba8-4a29-a4ed-6879798a8a71 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039872 Aug 29 20:23:53.313766 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 534/1067] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:53.615458 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:53.616350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:53.623350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:53.623844 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:53.624303 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:53.625017 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:53.625566 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:53.626083 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:53.780083 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:53.789894 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-51e5307f-cc7b-4dc3-b4a4-02ee29119536 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.179707 Aug 29 20:23:53.790478 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 534/1068] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:53 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:54.005936 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:54.006754 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:54.013139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:54.013604 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:54.014077 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:54.014963 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:54.015218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:54.015674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:54.172867 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:54.183143 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6e9e9451-8a08-4687-9789-dde6b744c483 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.181890 Aug 29 20:23:54.183732 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 535/1069] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:53 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:54.811623 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:54.812288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:54.819541 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:54.820045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:54.820481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:54.821198 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:54.821653 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:54.822115 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:54.985285 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:54.990312 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=100 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:54.996101 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4adaf51b-b54a-4011-b60e-7d9e5630a5af tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.188652 Aug 29 20:23:54.996851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 535/1070] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:54 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:55.205574 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:55.206484 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:55.212751 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:55.213240 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:55.213671 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:55.214390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:55.214843 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:55.215259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:55.358835 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:55.367317 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8515d6bd-d90d-4031-be3f-880f7ab7968c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.166145 Aug 29 20:23:55.367888 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 536/1071] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:55 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:56.019045 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:56.019600 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:56.026043 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:56.026523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:56.026956 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:56.027646 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:56.028096 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:56.028518 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:56.171266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:56.179071 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e2291f1e-2af9-428d-a236-eb525370de15 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.164071 Aug 29 20:23:56.179638 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 536/1072] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:56 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:56.389679 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:56.390306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:56.396897 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:56.397376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:56.397836 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:56.398525 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:56.398991 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:56.399390 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:56.549055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:56.557752 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-58fd2d4c-520d-4a51-ad7d-feaeb8646638 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.171892 Aug 29 20:23:56.558339 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 537/1073] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:56 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:56.918921 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-d128d8cd-8ebe-4ee7-b7d7-8b5f000c1a89 req-da733634-51c7-4c02-9917-a30f63e49716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0", "name": "network-vif-plugged", "status": "completed", "tag": "83c4727c-dd32-4e08-9379-33b1f266216a"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:56.926716 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:56.927618 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell0:SELECT=6 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:56.935041 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d128d8cd-8ebe-4ee7-b7d7-8b5f000c1a89 req-da733634-51c7-4c02-9917-a30f63e49716 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:56.935722 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d128d8cd-8ebe-4ee7-b7d7-8b5f000c1a89 req-da733634-51c7-4c02-9917-a30f63e49716 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:56.936266 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-d128d8cd-8ebe-4ee7-b7d7-8b5f000c1a89 req-da733634-51c7-4c02-9917-a30f63e49716 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:56.950987 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-d128d8cd-8ebe-4ee7-b7d7-8b5f000c1a89 req-da733634-51c7-4c02-9917-a30f63e49716 service nova] Creating event network-vif-plugged:83c4727c-dd32-4e08-9379-33b1f266216a for instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 on hv-cinder-85426 Aug 29 20:23:56.956927 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-d128d8cd-8ebe-4ee7-b7d7-8b5f000c1a89 req-da733634-51c7-4c02-9917-a30f63e49716 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041676 Aug 29 20:23:56.957761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 537/1074] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:57.202151 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:57.207701 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:57.217551 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:57.218072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:57.218554 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:57.219185 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:57.219637 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:57.220066 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:57.325115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=16 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:57.464456 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:57.474939 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f4c6aa66-7006-4940-93d3-975f4c12f3e4 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.278202 Aug 29 20:23:57.484727 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 538/1075] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:57 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:57.580868 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:57.581828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:57.593379 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:57.594066 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:57.594816 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:57.596531 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:57.597434 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:57.598129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:57.780577 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:57.791697 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dc114c52-b5d2-4605-9ddb-eda88d7e31b8 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.215655 Aug 29 20:23:57.792321 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 538/1076] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:57 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:58.496811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:58.497334 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:58.504816 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:58.505664 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:58.506454 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:58.507643 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:58.508379 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:58.509003 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:58.668125 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:58.684604 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-143c0f0b-a079-4b44-8fe2-1f5e185b936a tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.191509 Aug 29 20:23:58.701738 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 539/1077] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:58 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:58.819383 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:58.820302 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:58.827083 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:58.827572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:58.828007 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:58.828710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:58.829164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:58.829592 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:58.987170 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-23c837d4-7863-4ad7-bca0-e4aea2a374af req-c2bf5416-a465-47bd-903b-f8311bb69158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb00efd8-9531-4c67-a87a-7674b3bd7fe4", "name": "network-vif-plugged", "status": "completed", "tag": "383776ed-a60d-4566-92b4-4d7d1b6ee46c"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:58.997883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-23c837d4-7863-4ad7-bca0-e4aea2a374af req-c2bf5416-a465-47bd-903b-f8311bb69158 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:58.998352 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-23c837d4-7863-4ad7-bca0-e4aea2a374af req-c2bf5416-a465-47bd-903b-f8311bb69158 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:58.998774 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-23c837d4-7863-4ad7-bca0-e4aea2a374af req-c2bf5416-a465-47bd-903b-f8311bb69158 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:59.012083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-23c837d4-7863-4ad7-bca0-e4aea2a374af req-c2bf5416-a465-47bd-903b-f8311bb69158 service nova] Creating event network-vif-plugged:383776ed-a60d-4566-92b4-4d7d1b6ee46c for instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 on hv-cinder-85426 Aug 29 20:23:59.017400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-23c837d4-7863-4ad7-bca0-e4aea2a374af req-c2bf5416-a465-47bd-903b-f8311bb69158 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034924 Aug 29 20:23:59.018057 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 540/1078] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:59.288437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:59.296394 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d34b8339-5f97-4b37-8f70-5adbcb9fbfd9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1265 microversion: 2.1 time: 0.482745 Aug 29 20:23:59.296964 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 539/1079] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:58 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1265 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:59.717043 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:59.717774 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:59.724450 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:59.724930 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:59.725392 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:59.726129 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:59.726580 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:59.727001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:59.900248 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:59.920764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-49d56b44-6d04-4dd4-8a42-d0fb793d7b99 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.208771 Aug 29 20:23:59.921576 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 541/1080] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:23:59 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:00.328763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:00.330619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:00.333460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:00.340586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.341105 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.341619 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.342405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.342857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.343343 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.534259 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:00.547060 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-62735e89-61f5-4056-aecc-2e06f66ea7a9 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1452 microversion: 2.1 time: 0.223360 Aug 29 20:24:00.548149 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 540/1081] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:00 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:00.582082 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:00.582688 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:00.590194 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.591246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.592226 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.593872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.593872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.593872 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.808949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:00.828103 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-721c5f69-a556-41c1-96d5-6b710ad53de5 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1452 microversion: 2.1 time: 0.250284 Aug 29 20:24:00.828980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 542/1082] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:00 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1452 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:00.947222 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:00.948042 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:00.954837 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.955461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.955920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.956634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.957089 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.958159 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:01.137875 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:01.147805 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d2f8298b-e3ce-4281-96e7-5cc156c6ade2 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.205780 Aug 29 20:24:01.162175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 541/1083] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:00 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:02.178709 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:02.179550 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:02.185869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:02.186341 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:02.186761 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:02.187439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:02.187876 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:02.188288 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:02.426070 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:02.435055 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f87aee45-fd0e-4729-b22b-24a4c8fc9a17 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.260110 Aug 29 20:24:02.435827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 543/1084] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:02 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:02.957726 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-31996b44-4aea-4df8-a4af-f9fcbdc63c29 req-dd512f0e-c49a-4029-81b5-ddba054c5ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0", "tag": "83c4727c-dd32-4e08-9379-33b1f266216a"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:02.968279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-31996b44-4aea-4df8-a4af-f9fcbdc63c29 req-dd512f0e-c49a-4029-81b5-ddba054c5ee7 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:02.968279 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-31996b44-4aea-4df8-a4af-f9fcbdc63c29 req-dd512f0e-c49a-4029-81b5-ddba054c5ee7 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:02.971070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-31996b44-4aea-4df8-a4af-f9fcbdc63c29 req-dd512f0e-c49a-4029-81b5-ddba054c5ee7 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:02.990682 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-31996b44-4aea-4df8-a4af-f9fcbdc63c29 req-dd512f0e-c49a-4029-81b5-ddba054c5ee7 service nova] Creating event network-changed:83c4727c-dd32-4e08-9379-33b1f266216a for instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 on hv-cinder-85426 Aug 29 20:24:02.996613 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-31996b44-4aea-4df8-a4af-f9fcbdc63c29 req-dd512f0e-c49a-4029-81b5-ddba054c5ee7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043149 Aug 29 20:24:02.997328 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 542/1085] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:03.458045 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:03.458932 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:03.467920 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:03.468489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:03.469041 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:03.469990 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:03.470767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:03.471374 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:03.633697 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:03.642929 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8c443b83-cfa4-4412-aee2-8529e672322d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.189153 Aug 29 20:24:03.643487 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 544/1086] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:03 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:04.680128 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:04.681405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:04.691618 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:04.692334 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:04.693008 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:04.694219 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:04.695074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:04.695830 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:04.890573 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:04.900654 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dc035d97-1365-4e70-8ef0-95797ffaaae5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1367 microversion: 2.1 time: 0.228729 Aug 29 20:24:04.902706 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 543/1087] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:04 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:05.934625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:05.935250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:05.942533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:05.943011 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:05.943446 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:05.944138 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:05.944591 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:05.945008 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:06.117112 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:06.125257 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-98a865cf-ef52-4744-b1c6-54f351178214 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1558 microversion: 2.1 time: 0.197017 Aug 29 20:24:06.126542 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 545/1088] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:05 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1558 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:06.159155 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:06.160308 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:06.167136 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:06.167624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:06.168055 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:06.168757 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:06.169198 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:06.169862 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:06.258033 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b63ca8ec-6cfd-492c-88aa-81734d51fd64 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103763 Aug 29 20:24:06.259023 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 544/1089] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 29 20:24:06 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:07.685575 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-bc3736c7-3e29-45f5-aa85-c887f72912ee req-5d8db66d-1eac-4886-bd97-bf634b6e1606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb00efd8-9531-4c67-a87a-7674b3bd7fe4", "tag": "383776ed-a60d-4566-92b4-4d7d1b6ee46c"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:07.702584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-bc3736c7-3e29-45f5-aa85-c887f72912ee req-5d8db66d-1eac-4886-bd97-bf634b6e1606 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:07.703415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-bc3736c7-3e29-45f5-aa85-c887f72912ee req-5d8db66d-1eac-4886-bd97-bf634b6e1606 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:07.704681 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-bc3736c7-3e29-45f5-aa85-c887f72912ee req-5d8db66d-1eac-4886-bd97-bf634b6e1606 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:07.721522 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-bc3736c7-3e29-45f5-aa85-c887f72912ee req-5d8db66d-1eac-4886-bd97-bf634b6e1606 service nova] Creating event network-changed:383776ed-a60d-4566-92b4-4d7d1b6ee46c for instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 on hv-cinder-85426 Aug 29 20:24:07.732098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-bc3736c7-3e29-45f5-aa85-c887f72912ee req-5d8db66d-1eac-4886-bd97-bf634b6e1606 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053719 Aug 29 20:24:07.732714 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 546/1090] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:12.701817 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:12.702594 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:12.709300 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:12.709851 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:12.710373 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:12.711101 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:12.711620 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:12.712044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:12.815091 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lazy-loading 'services' on Instance uuid 70b3178e-cab8-4084-9853-7f2158716f4a {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:24:12.902664 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a40a43c8-6556-4a6f-a3b1-75926e3557a1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "DELETE /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a/os-volume_attachments/0894d7e5-1227-4762-8412-0fe5c47d73d2" status: 202 len: 0 microversion: 2.1 time: 0.205491 Aug 29 20:24:12.903460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 545/1091] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:24:12 2022] DELETE /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a/os-volume_attachments/0894d7e5-1227-4762-8412-0fe5c47d73d2 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:24:14.081790 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:14.082625 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:14.092460 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:14.093083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:14.094154 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:14.095142 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:14.095939 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:14.097140 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:14.138011 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:24:14.143089 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:14.232240 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-72cf09a8-7cc8-453b-8715-346fe6d2981d tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "DELETE /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 204 len: 0 microversion: 2.1 time: 0.155493 Aug 29 20:24:14.232831 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 547/1092] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:24:14 2022] DELETE /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:24:14.243734 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:14.245468 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:14.252944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:14.253528 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:14.254081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:14.254823 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:14.255287 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:14.255706 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:14.418801 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:14.428240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7d67d33a-771f-4b66-acdd-affc872d65d5 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1514 microversion: 2.1 time: 0.189159 Aug 29 20:24:14.428904 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 546/1093] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:14 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:15.458994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:15.460274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:15.470335 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:15.470908 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:15.471245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:15.471994 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:15.472442 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:15.472850 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:15.644507 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:15.659160 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7a93f416-6185-4351-8201-9246b594a429 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1514 microversion: 2.1 time: 0.207981 Aug 29 20:24:15.660035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 548/1094] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:15 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:16.692745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:16.693374 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:16.700157 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:16.700649 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:16.701081 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:16.701818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:16.702313 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:16.703248 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:16.909486 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:16.922642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-9a2164a9-769c-41e4-96de-597a2fec3ad1 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1514 microversion: 2.1 time: 0.233540 Aug 29 20:24:16.923234 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 547/1095] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:16 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:17.077757 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-dd90bbec-52b4-46e6-8e84-6a285f8a8423 req-aaf3f8ba-fec2-4705-beda-071f5b0e71d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b3178e-cab8-4084-9853-7f2158716f4a", "name": "network-vif-deleted", "tag": "6185c796-fc55-418e-a57e-a35ddb233dfa"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:17.088300 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-dd90bbec-52b4-46e6-8e84-6a285f8a8423 req-aaf3f8ba-fec2-4705-beda-071f5b0e71d3 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:17.088775 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-dd90bbec-52b4-46e6-8e84-6a285f8a8423 req-aaf3f8ba-fec2-4705-beda-071f5b0e71d3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:17.089198 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-dd90bbec-52b4-46e6-8e84-6a285f8a8423 req-aaf3f8ba-fec2-4705-beda-071f5b0e71d3 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:17.116299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-dd90bbec-52b4-46e6-8e84-6a285f8a8423 req-aaf3f8ba-fec2-4705-beda-071f5b0e71d3 service nova] Creating event network-vif-deleted:6185c796-fc55-418e-a57e-a35ddb233dfa for instance 70b3178e-cab8-4084-9853-7f2158716f4a on hv-cinder-85426 Aug 29 20:24:17.121163 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-dd90bbec-52b4-46e6-8e84-6a285f8a8423 req-aaf3f8ba-fec2-4705-beda-071f5b0e71d3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047178 Aug 29 20:24:17.121964 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 549/1096] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:17.945508 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:17.946655 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:17.957972 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:17.959091 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:17.959651 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:17.960914 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:17.961798 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:17.962567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:18.018674 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:18.019160 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:18.019592 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:18.020038 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.objects.instance [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lazy-loading 'fault' on Instance uuid 70b3178e-cab8-4084-9853-7f2158716f4a {{(pid=120787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:24:18.066389 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7f801e70d4e08b73a83451fd522b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6b1e6a93214e0fbe67b7dfb84f1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:18.073736 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-149aa96e-b9dd-4a5a-94f2-d2acc5baa29a tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 200 len: 1308 microversion: 2.1 time: 0.133609 Aug 29 20:24:18.074355 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 548/1097] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:17 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:19.100988 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:19.102022 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] [instance: 70b3178e-cab8-4084-9853-7f2158716f4a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:19.109274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:19.109773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:19.110203 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:19.110937 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:19.111388 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:19.111811 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:19.128990 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] HTTP exception thrown: Instance 70b3178e-cab8-4084-9853-7f2158716f4a could not be found. Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Request method failure captured: Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a HTTP/1.1 Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR_li_M9HGVQtdEbFwbSXbLZbrc7TLG48aFL7gXdq6Rpmr7W9wNuhLNx96UGXa2OMqbJf9JfhVehAhzW0hLaivfm_SKc0dK-UCukMt00xc5--DtBo1jp-x_Osq2OnCE1LR_SX-WmWWrBsGCwv-CtThZGimu-ILmZaxluH4mtWEZbn54 Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 3d6b1e6a93214e0fbe67b7dfb84f1043 Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2022608584 Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:24:19.130673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d6b1e6a93214e0fbe67b7dfb84f1043"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d6b1e6a93214e0fbe67b7dfb84f1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d6b1e6a93214e0fbe67b7dfb84f1043"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d6b1e6a93214e0fbe67b7dfb84f1043"}]}] Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesSnapshotTestJSON-2022608584 Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 3d6b1e6a93214e0fbe67b7dfb84f1043 Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2022608584 Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesSnapshotTestJSON-2022608584-project Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 47d7f801e70d4e08b73a83451fd522b1 Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesSnapshotTestJSON-2022608584-project Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 70b3178e-cab8-4084-9853-7f2158716f4a could not be found. Aug 29 20:24:19.132485 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '70b3178e-cab8-4084-9853-7f2158716f4a'} Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b3178e-cab8-4084-9853-7f2158716f4a could not be found. Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:24:19.133449 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b3178e-cab8-4084-9853-7f2158716f4a could not be found. Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b3178e-cab8-4084-9853-7f2158716f4a could not be found. Aug 29 20:24:19.136318 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:24:19.139156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] Returning 404 to user: Instance 70b3178e-cab8-4084-9853-7f2158716f4a could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:24:19.139156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5586d252-8ed0-46c7-9b8f-7fd099c77149 tempest-VolumesSnapshotTestJSON-2022608584 tempest-VolumesSnapshotTestJSON-2022608584-project] 10.222.0.73 "GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a" status: 404 len: 111 microversion: 2.1 time: 0.038522 Aug 29 20:24:19.139156 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 550/1098] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:19 2022] GET /compute/v2.1/servers/70b3178e-cab8-4084-9853-7f2158716f4a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:24:25.051408 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:25.054120 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:25.061033 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:25.061523 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:25.061984 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:25.062685 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:25.063137 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:25.063577 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:25.066606 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:25.147237 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-716b29d6-9e21-4e65-9950-d4bfa216c460 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "POST /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/action" status: 202 len: 0 microversion: 2.1 time: 0.100032 Aug 29 20:24:25.147909 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 549/1099] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:24:25 2022] POST /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:24:25.159980 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:25.160873 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:25.167582 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:25.170557 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:25.171744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:25.172167 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:25.173812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:25.174294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:25.175001 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:25.362614 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:25.378084 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d959a523-a78e-4cf4-89c9-9675ce9a2f28 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1751 microversion: 2.1 time: 0.223077 Aug 29 20:24:25.379465 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 551/1100] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:25 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:26.403034 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:26.404673 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:26.412319 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:26.413231 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:26.413615 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:26.414485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:26.415056 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:26.415669 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:26.616559 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:26.627232 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-17785853-664e-47fe-93e7-95fa1873a66b tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.229183 Aug 29 20:24:26.627785 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 550/1101] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:26 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:27.665672 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:27.666507 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:27.673592 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:27.674106 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:27.674536 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:27.675239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:27.675691 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:27.676109 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:27.880902 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:27.894744 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0f147abd-32ef-44ce-83d8-bc4a22ea1004 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.234221 Aug 29 20:24:27.901881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 552/1102] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:27 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:28.918230 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:28.919009 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:28.925574 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:28.926129 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:28.926671 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:28.927273 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:28.927721 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:28.928139 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:29.117968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:29.130037 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-263ddeed-b42d-4ab0-b4ef-4f633a8bf9c3 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.215757 Aug 29 20:24:29.130630 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 551/1103] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:28 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:30.152348 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:30.152943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:30.160127 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:30.160605 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:30.161035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:30.161771 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:30.162218 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:30.162642 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:30.340242 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:30.349675 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-477fd404-edda-4233-af0c-3d05bd4d11b2 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.201175 Aug 29 20:24:30.350293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 553/1104] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:30 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:31.377398 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:31.378014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:31.380424 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=26 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:31.386094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:31.386588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:31.387020 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:31.388567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:31.389207 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:31.389636 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:31.551000 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:31.560640 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-367a3c2e-1b57-4496-8374-d678d579f7db tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.186293 Aug 29 20:24:31.561236 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 552/1105] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:31 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:32.583093 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:32.583812 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:32.592640 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:32.593275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:32.593782 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:32.594597 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:32.595237 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:32.595674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:32.768982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:32.781503 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5a2e2ffc-76bf-4dbd-b301-b83adb547c78 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.202763 Aug 29 20:24:32.782376 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 554/1106] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:32 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:33.804773 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:33.805405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:33.811809 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:33.812286 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:33.812710 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:33.813407 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:33.813872 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:33.814284 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:34.000841 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:34.009950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-013359b5-56a9-4898-b1de-39fda3d7ea91 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.209208 Aug 29 20:24:34.010548 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 553/1107] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:33 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:35.035435 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:35.036450 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:35.049273 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:35.050196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:35.050907 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:35.052072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:35.052901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:35.053955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:35.233275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:35.242106 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13d16053-87a8-43dd-ba40-d8210cbda476 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.212887 Aug 29 20:24:35.242717 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 555/1108] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:35 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:36.268493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:36.269686 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:36.276718 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:36.277342 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:36.278881 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:36.279978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:36.280433 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:36.280856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:36.463349 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:36.474301 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-084e64e8-b55e-4c78-95c6-5e4f8232a9e1 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.212155 Aug 29 20:24:36.474887 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 554/1109] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:36 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:37.499726 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:37.500278 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:37.508786 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:37.509274 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:37.509848 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:37.510546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:37.510990 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:37.511506 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:37.694865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:37.705685 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-85fcd8b0-f674-4a0c-ad89-c0a360a9a8ff tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.210565 Aug 29 20:24:37.706424 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 556/1110] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:37 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:38.731513 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:38.732080 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:38.738624 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:38.739102 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:38.739525 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:38.740242 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:38.740683 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:38.741094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:38.898740 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:38.909729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d62e6768-12e5-4855-aa0d-753d23504691 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.183205 Aug 29 20:24:38.910481 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 555/1111] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:38 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:39.937362 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:39.938072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:39.948243 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:39.949146 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:39.949893 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:39.951106 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:39.951822 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:39.952403 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:40.167504 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:40.178299 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2ea9a6e3-5ba9-4503-aa0a-e960cc78e55a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.245470 Aug 29 20:24:40.178955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 557/1112] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:39 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:41.204139 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:41.204820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:41.212580 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.213177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.213621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.214395 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.215801 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.216276 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.412472 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:41.422302 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dc1405a1-786e-475d-ad96-46d354100408 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.223275 Aug 29 20:24:41.422883 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 556/1113] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:41 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:42.445161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:42.445999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:42.454542 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:42.455042 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:42.455529 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:42.456515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:42.457010 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:42.457565 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:42.711104 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:42.726452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2588b91c-d57e-4982-b743-32940b5cfded tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1756 microversion: 2.1 time: 0.284781 Aug 29 20:24:42.727529 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 558/1114] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:42 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1756 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:43.759069 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:43.759913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:43.767299 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:43.767783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:43.768212 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:43.768955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:43.769405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:43.769859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:44.007981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:44.017621 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-96bc45b0-a680-420e-86c8-337cd23adcb0 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1759 microversion: 2.1 time: 0.262551 Aug 29 20:24:44.018870 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 557/1115] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:24:43 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1759 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:53.190211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:53.190850 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:53.193554 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=15 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:53.194256 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:53.200251 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:53.200732 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:53.201165 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:53.201901 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:53.202346 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:53.202767 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:53.230566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-78f98930-dd94-4e4b-9707-8c6d07ee1daa tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/ips" status: 200 len: 150 microversion: 2.1 time: 0.045186 Aug 29 20:24:53.231151 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 559/1116] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:24:53 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:54.644550 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "871563ee-5ea3-49db-91c8-5e43cf305b80"}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:54.646994 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:54.649541 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=11 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:54.650262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:54.657101 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:54.657584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:54.658051 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:54.658783 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:54.659228 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:54.659646 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:54.983891 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-00cbb48c-1ef8-4af9-bc8e-89cfc274969d tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "POST /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342971 Aug 29 20:24:54.984337 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 558/1117] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 29 20:24:54 2022] POST /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:25:02.690865 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:02.691472 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:02.698412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.698891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.699322 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.700008 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.700457 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.700876 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.797124 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lazy-loading 'services' on Instance uuid bb00efd8-9531-4c67-a87a-7674b3bd7fe4 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:25:02.887944 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0abf43b6-9493-456e-a193-9275ddebeec6 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-volume_attachments/871563ee-5ea3-49db-91c8-5e43cf305b80" status: 202 len: 0 microversion: 2.1 time: 0.200981 Aug 29 20:25:02.888650 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 560/1118] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:25:02 2022] DELETE /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-volume_attachments/871563ee-5ea3-49db-91c8-5e43cf305b80 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:25:02.899026 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:02.902567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:02.909289 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.909899 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.910268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.910968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.911419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.911836 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.943598 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-19c8fdd5-1a26-4058-863b-772cb7bfe842 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050002 Aug 29 20:25:02.944169 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 559/1119] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:25:02 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:03.962415 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:03.965692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:03.971973 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:03.972442 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:03.972869 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:03.973546 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:03.974017 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:03.974438 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:04.006313 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0a3f432d-dc55-4fb1-a4b7-7937ab7de1e0 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050749 Aug 29 20:25:04.006876 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 561/1120] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:25:03 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:25:04.072479 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:04.073085 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:04.079874 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:04.080395 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:04.080787 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:04.081484 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:04.081971 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:04.082392 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:04.110596 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:25:04.196285 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b3eb0bd1-8b9f-47b9-98bb-74c20714b294 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 204 len: 0 microversion: 2.1 time: 0.127290 Aug 29 20:25:04.196983 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 560/1121] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:04 2022] DELETE /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:25:04.206395 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:04.207012 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:04.214399 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:04.215414 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:04.215942 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:04.216468 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:04.216992 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:04.217455 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:04.356683 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:04.364640 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-915b1063-86d9-46d6-b4d2-d57688a3e71e tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1682 microversion: 2.1 time: 0.162030 Aug 29 20:25:04.365211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 562/1122] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:04 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:05.387537 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:05.389194 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:05.396253 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:05.396730 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:05.397451 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:05.398324 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:05.398913 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:05.399400 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:05.556607 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:05.565872 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-15aa4450-87b7-4933-84d8-0f899da087fe tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1682 microversion: 2.1 time: 0.182516 Aug 29 20:25:05.566490 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 561/1123] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:05 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:06.588713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:06.589382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:06.599682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:06.600870 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:06.602046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:06.603245 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:06.603704 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:06.604692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:06.773188 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:06.785759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8a93d3b5-0368-4553-9d8c-a8596f7ef794 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1682 microversion: 2.1 time: 0.200774 Aug 29 20:25:06.786897 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 563/1124] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:06 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:07.030156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-8d30374e-5d3d-4c03-bf61-9c80a999f95c req-d91f58a3-1725-47e6-a265-228f3ddaaa09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb00efd8-9531-4c67-a87a-7674b3bd7fe4", "name": "network-vif-deleted", "tag": "383776ed-a60d-4566-92b4-4d7d1b6ee46c"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:07.045117 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-8d30374e-5d3d-4c03-bf61-9c80a999f95c req-d91f58a3-1725-47e6-a265-228f3ddaaa09 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:07.046095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-8d30374e-5d3d-4c03-bf61-9c80a999f95c req-d91f58a3-1725-47e6-a265-228f3ddaaa09 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:07.046813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-8d30374e-5d3d-4c03-bf61-9c80a999f95c req-d91f58a3-1725-47e6-a265-228f3ddaaa09 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:07.077949 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-8d30374e-5d3d-4c03-bf61-9c80a999f95c req-d91f58a3-1725-47e6-a265-228f3ddaaa09 service nova] Creating event network-vif-deleted:383776ed-a60d-4566-92b4-4d7d1b6ee46c for instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 on hv-cinder-85426 Aug 29 20:25:07.084659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-8d30374e-5d3d-4c03-bf61-9c80a999f95c req-d91f58a3-1725-47e6-a265-228f3ddaaa09 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062844 Aug 29 20:25:07.085642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 562/1125] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:07.809367 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:07.810411 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:07.817579 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:07.818092 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:07.818891 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:07.819598 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:07.820056 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:07.820630 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:07.861541 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:07.862783 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:07.863527 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:07.864523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lazy-loading 'fault' on Instance uuid bb00efd8-9531-4c67-a87a-7674b3bd7fe4 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:25:07.916845 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c8422c3d314adca25acf967ffd0998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0b0ec6aaf40ba8f5ba9e3abdeebb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:07.924382 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ded83977-0125-4dd1-a464-629febb0be2f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 200 len: 1331 microversion: 2.1 time: 0.120248 Aug 29 20:25:07.924962 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 564/1126] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:07 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:08.948070 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:08.948857 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:08.954892 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:08.955371 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:08.955804 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:08.956507 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:08.956955 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:08.957376 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:08.972659 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 HTTP/1.1 Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:08.974405 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:08.976167 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'bb00efd8-9531-4c67-a87a-7674b3bd7fe4'} Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:08.977153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:08.978869 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:08.980252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:08.980252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-f457ebf4-4974-4864-8e47-f2541c5ad8f1 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 404 len: 111 microversion: 2.1 time: 0.032992 Aug 29 20:25:08.980252 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 563/1127] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:08 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:08.984773 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-794f4c5c-14ab-428a-8585-3c373b4216f7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '.version_select at 0x7f15f9db9e50>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:09.004523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-794f4c5c-14ab-428a-8585-3c373b4216f7 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534733868" status: 202 len: 0 microversion: 2.1 time: 0.023465 Aug 29 20:25:09.005103 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 565/1128] 10.222.0.73 () {58 vars in 1221 bytes} [Mon Aug 29 20:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534733868 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:25:10.822729 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:10.823296 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:10.830177 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:10.830661 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:10.831094 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:10.831818 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:10.832268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:10.832696 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:10.849563 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: DELETE /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 HTTP/1.1 Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:10.851164 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.853264 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'bb00efd8-9531-4c67-a87a-7674b3bd7fe4'} Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:10.855358 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.857866 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.860174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:10.860174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-a2eb404a-1cf5-4756-9872-b10157d1c2b5 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 404 len: 111 microversion: 2.1 time: 0.033670 Aug 29 20:25:10.860174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 564/1129] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:10 2022] DELETE /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:10.862319 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:10.862931 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: bb00efd8-9531-4c67-a87a-7674b3bd7fe4] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:10.870197 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:10.870679 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:10.871111 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:10.871803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:10.872256 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:10.872682 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:10.886916 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 HTTP/1.1 Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:25:10.888571 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.890306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'bb00efd8-9531-4c67-a87a-7674b3bd7fe4'} Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:10.891275 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. Aug 29 20:25:10.892883 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:10.894464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance bb00efd8-9531-4c67-a87a-7674b3bd7fe4 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:10.894464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4dc9cc58-37c2-47bb-ad5d-70342eed7b6f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4" status: 404 len: 111 microversion: 2.1 time: 0.031743 Aug 29 20:25:10.894464 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 566/1130] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:10 2022] GET /compute/v2.1/servers/bb00efd8-9531-4c67-a87a-7674b3bd7fe4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:12.041203 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:12.041769 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:12.048543 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:12.049027 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:12.049492 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:12.050344 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:12.050796 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:12.051221 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:12.075944 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: DELETE /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af HTTP/1.1 Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:12.077506 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.082828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '7c9edd36-10af-43d8-ba3c-8232ef5809af'} Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:12.083896 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.085425 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.087165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:12.087165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7fb2bff8-615c-4ddf-8e09-8ca3f0354e1b tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 404 len: 111 microversion: 2.1 time: 0.042356 Aug 29 20:25:12.087165 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 565/1131] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:12 2022] DELETE /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:12.092120 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:12.093211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 7c9edd36-10af-43d8-ba3c-8232ef5809af] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:12.100223 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:12.100838 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:12.101338 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:12.102137 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:12.102588 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:12.103007 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:12.118439 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af HTTP/1.1 Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:25:12.120400 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.123047 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '7c9edd36-10af-43d8-ba3c-8232ef5809af'} Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:12.124412 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. Aug 29 20:25:12.126806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.129294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance 7c9edd36-10af-43d8-ba3c-8232ef5809af could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:12.129294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1d7679cf-0f28-4bce-9b8a-83102056e100 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af" status: 404 len: 111 microversion: 2.1 time: 0.036321 Aug 29 20:25:12.129294 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 567/1132] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:12 2022] GET /compute/v2.1/servers/7c9edd36-10af-43d8-ba3c-8232ef5809af => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:12.135397 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:12.136176 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:12.145384 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:12.146745 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:12.147572 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:12.147981 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:12.148699 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:12.149383 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:12.168925 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: DELETE /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d HTTP/1.1 Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:12.170676 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.173437 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'f30c5f72-8898-482c-85c6-2556a5d7df9d'} Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:12.175074 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.177209 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.180161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:12.180161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dd3dacd7-3be9-4e88-b932-86efea2fb3bd tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 404 len: 111 microversion: 2.1 time: 0.044256 Aug 29 20:25:12.180161 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 566/1133] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:12 2022] DELETE /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:12.184176 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:12.184824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: f30c5f72-8898-482c-85c6-2556a5d7df9d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:12.192866 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:12.193353 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:12.193862 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:12.194550 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:12.194995 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:12.195406 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:12.218759 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d HTTP/1.1 Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:25:12.221564 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.224370 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'f30c5f72-8898-482c-85c6-2556a5d7df9d'} Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:12.226141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. Aug 29 20:25:12.229360 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:12.232019 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance f30c5f72-8898-482c-85c6-2556a5d7df9d could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:12.232019 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-68b18c99-65dc-4d7b-acd6-90a4c3c411ec tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d" status: 404 len: 111 microversion: 2.1 time: 0.044477 Aug 29 20:25:12.232019 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 568/1134] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:12 2022] GET /compute/v2.1/servers/f30c5f72-8898-482c-85c6-2556a5d7df9d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:13.393943 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:13.394496 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:13.402268 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:13.402758 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:13.403195 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:13.403899 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:13.404350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:13.404775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:13.419950 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: DELETE /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 HTTP/1.1 Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:13.421549 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.423095 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '3fa729ec-2c90-4d71-ab0a-23d73b1dd267'} Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:13.423905 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.425426 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.427530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:13.427530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-b373eee3-3fbf-429c-a098-5a813fd4b062 tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 404 len: 111 microversion: 2.1 time: 0.032951 Aug 29 20:25:13.427530 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 567/1135] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:13 2022] DELETE /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:13.433076 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:13.433974 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] [instance: 3fa729ec-2c90-4d71-ab0a-23d73b1dd267] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:13.440329 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:13.440806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:13.441232 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:13.441953 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:13.442477 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:13.442860 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:13.456897 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] HTTP exception thrown: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Request method failure captured: Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 HTTP/1.1 Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR8oep37Cw92eOYKyB6oOyEgA0wjjciwIKJcT31KMFn2whaYRBZg380zJwM-Druy5g6GCNdUf8Ekgg0IdyzoEvqQPsZONGRcttPTOUblybrLpBvbJI2tn6omZdk0kDH3NuL9jc7YZQ0epV0XxRqlEYb7ajIwTDAqOGHX-XoA1Z51nwE Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:25:13.458452 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8ee0b0ec6aaf40ba8f5ba9e3abdeebb8"}]}] Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 8ee0b0ec6aaf40ba8f5ba9e3abdeebb8 Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-851227091 Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: c7c8422c3d314adca25acf967ffd0998 Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-851227091-project Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.460098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '3fa729ec-2c90-4d71-ab0a-23d73b1dd267'} Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:13.461204 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. Aug 29 20:25:13.462788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:13.464195 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] Returning 404 to user: Instance 3fa729ec-2c90-4d71-ab0a-23d73b1dd267 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:13.464195 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c74edad6-f740-4027-bed1-6bde103b903f tempest-AttachVolumeNegativeTest-851227091 tempest-AttachVolumeNegativeTest-851227091-project] 10.222.0.73 "GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267" status: 404 len: 111 microversion: 2.1 time: 0.031463 Aug 29 20:25:13.464195 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 569/1136] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:13 2022] GET /compute/v2.1/servers/3fa729ec-2c90-4d71-ab0a-23d73b1dd267 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:18.294263 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-cf782a69-7342-4bc4-91de-265f5628fe13 tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Action: 'create', calling method: .version_select at 0x7f15fa0154c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-778642988", "metadata": {"Type": "work"}}} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:18.606526 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-cf782a69-7342-4bc4-91de-265f5628fe13 tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.430151 Aug 29 20:25:18.607153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 568/1137] 10.222.0.73 () {60 vars in 1156 bytes} [Mon Aug 29 20:25:18 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 20:25:18.620907 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-58c44849-1991-4744-a286-30605756ea9d tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Calling method '.version_select at 0x7f15f9ee7d30>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:18.688141 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-58c44849-1991-4744-a286-30605756ea9d tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70" status: 200 len: 352 microversion: 2.1 time: 0.072442 Aug 29 20:25:18.688735 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 570/1138] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:25:18 2022] GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70 => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:19.703071 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4fe80184-c77e-4c40-b826-c9591b45d32d tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Calling method '.version_select at 0x7f15f9ec8670>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:19.751761 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4fe80184-c77e-4c40-b826-c9591b45d32d tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70" status: 200 len: 353 microversion: 2.1 time: 0.052917 Aug 29 20:25:19.752331 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 569/1139] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:25:19 2022] GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:19.765672 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7e22db90-3b23-4c2d-844f-91b970c32473 tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Calling method '.version_select at 0x7f15f9e27a60>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:19.815806 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7e22db90-3b23-4c2d-844f-91b970c32473 tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70" status: 200 len: 353 microversion: 2.1 time: 0.054267 Aug 29 20:25:19.816432 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 571/1140] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:25:19 2022] GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:25:19.833677 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-7bfa6a2f-f408-4aa8-a9ee-909a4a0185bb tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Calling method '.version_select at 0x7f15f9eb1940>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:19.897821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-7bfa6a2f-f408-4aa8-a9ee-909a4a0185bb tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70" status: 202 len: 0 microversion: 2.1 time: 0.067398 Aug 29 20:25:19.898551 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 570/1141] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 29 20:25:19 2022] DELETE /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:25:19.907209 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3918da20-4e66-4227-9603-42d8aa4279df tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Calling method '.version_select at 0x7f15f9e5cdc0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:19.961298 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3918da20-4e66-4227-9603-42d8aa4279df tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70" status: 200 len: 352 microversion: 2.1 time: 0.057914 Aug 29 20:25:19.961999 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 572/1142] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:25:19 2022] GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:20.975938 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-88339e5c-c64f-4455-95ad-51b8a058aeec tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Calling method '.version_select at 0x7f15fa015670>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:21.005553 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-88339e5c-c64f-4455-95ad-51b8a058aeec tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] HTTP exception thrown: Volume e510dde3-db00-4b96-8062-0ebb9c599a70 could not be found. Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-88339e5c-c64f-4455-95ad-51b8a058aeec tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Request method failure captured: Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70 HTTP/1.1 Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDSCuZX7EtpSeCp1g7xZ7988rnGptXZVcx70RAR8tCmz21zaU1PbOoJoBt_4waCQ_IfnRi31dVi7BaKA1UWO_A5ofCRoI2s4udc2a798LifK0Wn_tHc25cmzE7hQ15M_sN44gobHKmEfbLue-_HiCBxeLmKUJM7A3Qd9UuWKS8pe6iUs Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: b635e4623a1247498404d5d63917f30a Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-VolumesGetTestJSON-1915644773 Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:21.007534 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b635e4623a1247498404d5d63917f30a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b635e4623a1247498404d5d63917f30a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b635e4623a1247498404d5d63917f30a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b635e4623a1247498404d5d63917f30a"}]}] Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-VolumesGetTestJSON-1915644773 Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: b635e4623a1247498404d5d63917f30a Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-VolumesGetTestJSON-1915644773 Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-VolumesGetTestJSON-1915644773-project Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 4a2b83905f844d97a229d443a05e5bef Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-VolumesGetTestJSON-1915644773-project Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Volume e510dde3-db00-4b96-8062-0ebb9c599a70 could not be found. Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'e510dde3-db00-4b96-8062-0ebb9c599a70'} Aug 29 20:25:21.009240 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e510dde3-db00-4b96-8062-0ebb9c599a70 could not be found. (HTTP 404) (Request-ID: req-52f909ae-4522-488b-90de-0224f5637127) Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:21.010420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:25:21.012127 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e510dde3-db00-4b96-8062-0ebb9c599a70 could not be found. Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:25:21.013759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e510dde3-db00-4b96-8062-0ebb9c599a70 could not be found. Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e510dde3-db00-4b96-8062-0ebb9c599a70 could not be found. Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-88339e5c-c64f-4455-95ad-51b8a058aeec tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] Returning 404 to user: Volume e510dde3-db00-4b96-8062-0ebb9c599a70 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-88339e5c-c64f-4455-95ad-51b8a058aeec tempest-VolumesGetTestJSON-1915644773 tempest-VolumesGetTestJSON-1915644773-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70" status: 404 len: 109 microversion: 2.1 time: 0.037804 Aug 29 20:25:21.015345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 571/1143] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 29 20:25:20 2022] GET /compute/v2.1/os-volumes/e510dde3-db00-4b96-8062-0ebb9c599a70 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:22.544162 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-489003092"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:22.544713 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:22.551053 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:22.551540 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:22.551969 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:22.552692 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:22.553147 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:22.553568 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:22.701027 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.network.security_group_api [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Removing security group 42c809db-d3ae-4ce7-b504-c65e2d6a2566 from port fc186e24-1eed-41aa-8b3e-068089cecf38 Aug 29 20:25:23.035822 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1ef54214-66ca-45bd-9963-0628f834f59a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "POST /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/action" status: 202 len: 0 microversion: 2.1 time: 0.495951 Aug 29 20:25:23.037566 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 573/1144] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 29 20:25:22 2022] POST /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:25:23.050586 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-4cfdfe11-f212-4594-8b25-5e1167b04233 req-ab09e693-3c40-4f6c-9c8a-eabf76b49d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2440bc1d-da88-474e-85cd-05ca2f4c4f45", "tag": "fc186e24-1eed-41aa-8b3e-068089cecf38"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:23.075461 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-4cfdfe11-f212-4594-8b25-5e1167b04233 req-ab09e693-3c40-4f6c-9c8a-eabf76b49d29 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:23.075977 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-4cfdfe11-f212-4594-8b25-5e1167b04233 req-ab09e693-3c40-4f6c-9c8a-eabf76b49d29 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:23.076504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-4cfdfe11-f212-4594-8b25-5e1167b04233 req-ab09e693-3c40-4f6c-9c8a-eabf76b49d29 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:23.091103 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-4cfdfe11-f212-4594-8b25-5e1167b04233 req-ab09e693-3c40-4f6c-9c8a-eabf76b49d29 service nova] Creating event network-changed:fc186e24-1eed-41aa-8b3e-068089cecf38 for instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 on hv-cinder-85426 Aug 29 20:25:23.096538 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-4cfdfe11-f212-4594-8b25-5e1167b04233 req-ab09e693-3c40-4f6c-9c8a-eabf76b49d29 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052470 Aug 29 20:25:23.097445 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 572/1145] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:24.610797 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:24.611321 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:24.613278 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:24.619629 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:24.620116 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:24.620551 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:24.621252 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:24.621693 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:24.622343 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:24.627281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:24.720834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lazy-loading 'services' on Instance uuid 2440bc1d-da88-474e-85cd-05ca2f4c4f45 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:25:24.820700 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1de9e8ee-a18d-469e-951f-e716c235ceec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments/31b4cc52-ec89-42ab-8c49-3b9b536757b5" status: 202 len: 0 microversion: 2.1 time: 0.214092 Aug 29 20:25:24.821345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 574/1146] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:25:24 2022] DELETE /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments/31b4cc52-ec89-42ab-8c49-3b9b536757b5 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:25:24.846917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:24.855859 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:24.870588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:24.873014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:24.875151 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:24.875686 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:24.876494 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:24.878191 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:24.878918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:24.892584 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:24.930968 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-88a3c6ac-c2af-47fd-94a8-56813103a1be tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103276 Aug 29 20:25:24.931557 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 573/1147] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:25:24 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:25.126454 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-8e9d19b3-8910-4791-a359-f1a25d1ee725 req-2ceea3e3-8463-4cb7-991f-1721f678f961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2440bc1d-da88-474e-85cd-05ca2f4c4f45", "tag": "fc186e24-1eed-41aa-8b3e-068089cecf38"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:25.136956 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8e9d19b3-8910-4791-a359-f1a25d1ee725 req-2ceea3e3-8463-4cb7-991f-1721f678f961 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:25.137528 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8e9d19b3-8910-4791-a359-f1a25d1ee725 req-2ceea3e3-8463-4cb7-991f-1721f678f961 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:25.138048 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8e9d19b3-8910-4791-a359-f1a25d1ee725 req-2ceea3e3-8463-4cb7-991f-1721f678f961 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:25.151161 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-8e9d19b3-8910-4791-a359-f1a25d1ee725 req-2ceea3e3-8463-4cb7-991f-1721f678f961 service nova] Creating event network-changed:fc186e24-1eed-41aa-8b3e-068089cecf38 for instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 on hv-cinder-85426 Aug 29 20:25:25.156345 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-8e9d19b3-8910-4791-a359-f1a25d1ee725 req-2ceea3e3-8463-4cb7-991f-1721f678f961 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034020 Aug 29 20:25:25.157046 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 575/1148] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:25.945295 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:25.949368 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:25.958278 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:25.959345 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:25.960038 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:25.961175 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:25.962542 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:25.963497 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:25.997540 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-d0c31d3b-f239-4c77-916b-f48bfdec2353 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057351 Aug 29 20:25:26.001862 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 574/1149] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 29 20:25:25 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:25:26.011515 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:26.012158 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:26.018601 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:26.019076 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:26.019508 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:26.020263 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:26.021072 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:26.021674 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:26.114090 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] HTTP exception thrown: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 is not attached to volume 31b4cc52-ec89-42ab-8c49-3b9b536757b5 Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Request method failure captured: Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments/31b4cc52-ec89-42ab-8c49-3b9b536757b5 HTTP/1.1 Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDSAV3dyVDE4Aequ71fvn5T0yNPxc9GoJNdPe6yjiPkcGWMMXOBr-Xj7wOEWlNDNxe7mRwsPs2YSZxH_h8tIYCaVT326OE2jJwInRg3o74DsMXRnyT5C39VYA7VisMtjdHqxVfR2NuIXl-7XLC2cUT1izaaGwmztFqfjKKVlQkmpcZ9A Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 9f9f5a2386e2451f9a9b833859343595 Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestMinimumBasicScenario-1575831382 Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:25:26.116612 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f9f5a2386e2451f9a9b833859343595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f9f5a2386e2451f9a9b833859343595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9f9f5a2386e2451f9a9b833859343595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9f9f5a2386e2451f9a9b833859343595"}]}] Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestMinimumBasicScenario-1575831382 Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 9f9f5a2386e2451f9a9b833859343595 Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1575831382 Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestMinimumBasicScenario-1575831382-project Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: fc11bab9d92c48e3938593035b837da1 Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestMinimumBasicScenario-1575831382-project Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:25:26.118803 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 is not attached to volume 31b4cc52-ec89-42ab-8c49-3b9b536757b5 Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'server_id': '2440bc1d-da88-474e-85cd-05ca2f4c4f45', 'id': '31b4cc52-ec89-42ab-8c49-3b9b536757b5'} Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 31b4cc52-ec89-42ab-8c49-3b9b536757b5. Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:26.119622 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 is not attached to volume 31b4cc52-ec89-42ab-8c49-3b9b536757b5 Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 is not attached to volume 31b4cc52-ec89-42ab-8c49-3b9b536757b5 Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:26.121179 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Returning 404 to user: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 is not attached to volume 31b4cc52-ec89-42ab-8c49-3b9b536757b5 {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:26.122292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2411b9fe-6ac2-4e68-bc19-ec9171a3b52a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments/31b4cc52-ec89-42ab-8c49-3b9b536757b5" status: 404 len: 154 microversion: 2.1 time: 0.112918 Aug 29 20:25:26.122292 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 576/1150] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 29 20:25:26 2022] DELETE /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45/os-volume_attachments/31b4cc52-ec89-42ab-8c49-3b9b536757b5 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:30.441854 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:30.442352 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:30.450547 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:30.451033 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:30.451474 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:30.452174 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:30.452622 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:30.453048 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:30.480775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:25:30.566597 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-97ae3652-5d1d-4d31-a069-f5107f9dfbec tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 204 len: 0 microversion: 2.1 time: 0.128268 Aug 29 20:25:30.567466 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 575/1151] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:30 2022] DELETE /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:25:30.579393 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:30.580006 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:30.587652 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:30.588132 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:30.588572 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:30.589304 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:30.589786 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:30.590293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:30.743212 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:30.751703 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2691c5da-a1d7-49bb-9d89-34fb6a158f89 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1555 microversion: 2.1 time: 0.176105 Aug 29 20:25:30.752284 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 577/1152] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:30 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:31.774578 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:31.775543 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:31.782415 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:31.782897 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:31.783332 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:31.784044 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:31.784493 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:31.784918 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:31.941039 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:31.950763 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-dc964cb7-cecb-4009-b71c-4e616bee7b2e tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1555 microversion: 2.1 time: 0.180386 Aug 29 20:25:31.964597 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 576/1153] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:31 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:25:32.972182 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:32.972868 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:32.980440 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:32.980920 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:32.981346 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:32.982083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:32.982530 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:32.982943 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:33.127954 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:33.136534 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9b3efae3-fd36-479a-8cbd-e5b6cd64878a tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1555 microversion: 2.1 time: 0.168119 Aug 29 20:25:33.137139 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 578/1154] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:32 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:33.415737 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-a3191e88-25a1-4cab-bb24-390a5ff40cfd req-07de8349-f4ea-40c8-b1f6-c8e7d9c7434b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2440bc1d-da88-474e-85cd-05ca2f4c4f45", "name": "network-vif-deleted", "tag": "fc186e24-1eed-41aa-8b3e-068089cecf38"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:33.426978 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a3191e88-25a1-4cab-bb24-390a5ff40cfd req-07de8349-f4ea-40c8-b1f6-c8e7d9c7434b service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:33.427446 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a3191e88-25a1-4cab-bb24-390a5ff40cfd req-07de8349-f4ea-40c8-b1f6-c8e7d9c7434b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:33.427931 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-a3191e88-25a1-4cab-bb24-390a5ff40cfd req-07de8349-f4ea-40c8-b1f6-c8e7d9c7434b service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:33.441363 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-a3191e88-25a1-4cab-bb24-390a5ff40cfd req-07de8349-f4ea-40c8-b1f6-c8e7d9c7434b service nova] Creating event network-vif-deleted:fc186e24-1eed-41aa-8b3e-068089cecf38 for instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 on hv-cinder-85426 Aug 29 20:25:33.448355 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-a3191e88-25a1-4cab-bb24-390a5ff40cfd req-07de8349-f4ea-40c8-b1f6-c8e7d9c7434b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Aug 29 20:25:33.450135 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 577/1155] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:34.161098 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:34.161958 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:34.169589 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:34.170315 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:34.170788 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:34.171521 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:34.171975 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:34.172397 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:34.216083 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:34.216569 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:34.217008 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:34.217461 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lazy-loading 'fault' on Instance uuid 2440bc1d-da88-474e-85cd-05ca2f4c4f45 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:25:34.267581 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc11bab9d92c48e3938593035b837da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f5a2386e2451f9a9b833859343595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:34.276659 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ef573ef4-3350-40dd-9fd6-a1ee885dd68d tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 200 len: 1349 microversion: 2.1 time: 0.120325 Aug 29 20:25:34.277250 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 579/1156] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:34 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 1349 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:35.299821 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:35.300567 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] [instance: 2440bc1d-da88-474e-85cd-05ca2f4c4f45] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:35.307856 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:35.308357 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:35.308780 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:35.309486 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:35.309963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:35.310389 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:35.324649 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] HTTP exception thrown: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 could not be found. Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Request method failure captured: Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 HTTP/1.1 Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDSAV3dyVDE4Aequ71fvn5T0yNPxc9GoJNdPe6yjiPkcGWMMXOBr-Xj7wOEWlNDNxe7mRwsPs2YSZxH_h8tIYCaVT326OE2jJwInRg3o74DsMXRnyT5C39VYA7VisMtjdHqxVfR2NuIXl-7XLC2cUT1izaaGwmztFqfjKKVlQkmpcZ9A Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: 9f9f5a2386e2451f9a9b833859343595 Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-TestMinimumBasicScenario-1575831382 Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:35.326360 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f9f5a2386e2451f9a9b833859343595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f9f5a2386e2451f9a9b833859343595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9f9f5a2386e2451f9a9b833859343595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9f9f5a2386e2451f9a9b833859343595"}]}] Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-TestMinimumBasicScenario-1575831382 Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: 9f9f5a2386e2451f9a9b833859343595 Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1575831382 Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-TestMinimumBasicScenario-1575831382-project Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: fc11bab9d92c48e3938593035b837da1 Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-TestMinimumBasicScenario-1575831382-project Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 could not be found. Aug 29 20:25:35.327917 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '2440bc1d-da88-474e-85cd-05ca2f4c4f45'} Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 could not be found. Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:35.328824 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 could not be found. Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 could not be found. Aug 29 20:25:35.331064 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:35.333667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Returning 404 to user: Instance 2440bc1d-da88-474e-85cd-05ca2f4c4f45 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:35.333667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-e6c1b0c9-cd04-48d3-a706-09d086b79137 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45" status: 404 len: 111 microversion: 2.1 time: 0.032917 Aug 29 20:25:35.333667 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 578/1157] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:35 2022] GET /compute/v2.1/servers/2440bc1d-da88-474e-85cd-05ca2f4c4f45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:35.337158 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8018ec5e-3868-4dd3-b863-518ac66cf364 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] Calling method '.version_select at 0x7f15f9f49700>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:35.358734 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8018ec5e-3868-4dd3-b863-518ac66cf364 tempest-TestMinimumBasicScenario-1575831382 tempest-TestMinimumBasicScenario-1575831382-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1618751018" status: 202 len: 0 microversion: 2.1 time: 0.025895 Aug 29 20:25:35.359946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 580/1158] 10.222.0.73 () {58 vars in 1272 bytes} [Mon Aug 29 20:25:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1618751018 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:25:43.708281 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:43.709156 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:43.711706 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-3fd7707c-1a2e-42f2-8582-d976feb7d05b req-c9d67966-ab83-4892-b6df-0f73ef34de69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0", "tag": "83c4727c-dd32-4e08-9379-33b1f266216a"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:43.734949 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3fd7707c-1a2e-42f2-8582-d976feb7d05b req-c9d67966-ab83-4892-b6df-0f73ef34de69 service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:43.735451 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3fd7707c-1a2e-42f2-8582-d976feb7d05b req-c9d67966-ab83-4892-b6df-0f73ef34de69 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:43.735878 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3fd7707c-1a2e-42f2-8582-d976feb7d05b req-c9d67966-ab83-4892-b6df-0f73ef34de69 service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:43.736904 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:43.737671 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:43.738153 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:43.738759 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:43.740474 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:43.741887 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:43.758423 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-3fd7707c-1a2e-42f2-8582-d976feb7d05b req-c9d67966-ab83-4892-b6df-0f73ef34de69 service nova] Creating event network-changed:83c4727c-dd32-4e08-9379-33b1f266216a for instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 on hv-cinder-85426 Aug 29 20:25:43.771239 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-3fd7707c-1a2e-42f2-8582-d976feb7d05b req-c9d67966-ab83-4892-b6df-0f73ef34de69 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063656 Aug 29 20:25:43.776984 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 581/1159] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:43.806194 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Going to try to terminate instance {{(pid=120787) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:25:44.013933 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-bce34dcb-c80e-4585-90cb-4de446dd9385 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 204 len: 0 microversion: 2.1 time: 0.312858 Aug 29 20:25:44.019158 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 579/1160] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:43 2022] DELETE /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:25:44.029035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:44.029996 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:44.041976 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:44.042750 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:44.043732 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:44.044657 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:44.045293 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:44.046518 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:44.272824 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:44.283073 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6505b200-6f82-4a81-a9d0-2bda0efa5d69 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1577 microversion: 2.1 time: 0.261324 Aug 29 20:25:44.283764 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 582/1161] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:44 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1577 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:45.311948 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:45.313013 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:45.322813 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:45.323385 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:45.324525 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:45.325516 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:45.326131 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:45.326752 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:45.590588 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:45.599828 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-6271d76f-877b-464d-8ef9-56ae0657a2ec tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1577 microversion: 2.1 time: 0.296144 Aug 29 20:25:45.600446 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 580/1162] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:45 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1577 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:46.624955 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:46.625813 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:46.640035 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:46.641059 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:46.641853 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:46.643338 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:46.644337 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:46.644982 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:47.130394 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:47.144923 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9bbdfc99-7a05-4ae6-a923-631c5e92af7b tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1577 microversion: 2.1 time: 0.523669 Aug 29 20:25:47.158201 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 583/1163] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:46 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1577 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:47.361956 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-22d05e0b-7c2a-4a67-b3a7-22d34855479c req-6de6b29a-584b-4e69-96d5-469f2ef86caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0", "name": "network-vif-deleted", "tag": "83c4727c-dd32-4e08-9379-33b1f266216a"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:47.372731 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-22d05e0b-7c2a-4a67-b3a7-22d34855479c req-6de6b29a-584b-4e69-96d5-469f2ef86caf service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:47.373217 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-22d05e0b-7c2a-4a67-b3a7-22d34855479c req-6de6b29a-584b-4e69-96d5-469f2ef86caf service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:47.373670 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-22d05e0b-7c2a-4a67-b3a7-22d34855479c req-6de6b29a-584b-4e69-96d5-469f2ef86caf service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:47.389749 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-22d05e0b-7c2a-4a67-b3a7-22d34855479c req-6de6b29a-584b-4e69-96d5-469f2ef86caf service nova] Creating event network-vif-deleted:83c4727c-dd32-4e08-9379-33b1f266216a for instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 on hv-cinder-85426 Aug 29 20:25:47.395112 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-22d05e0b-7c2a-4a67-b3a7-22d34855479c req-6de6b29a-584b-4e69-96d5-469f2ef86caf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036502 Aug 29 20:25:47.396262 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 581/1164] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:48.169997 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:48.170669 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:48.178827 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:48.179211 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:48.179756 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:48.180584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:48.181136 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:48.181854 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:48.218507 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:48.218996 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:48.220757 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:48.220757 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lazy-loading 'fault' on Instance uuid f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:25:48.278119 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:48.295533 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a2cff14c-8d40-49a7-b760-34a4c10e63e0 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 200 len: 1229 microversion: 2.1 time: 0.129418 Aug 29 20:25:48.296115 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 584/1165] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:48 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 1229 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:49.319254 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:49.320052 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:49.328388 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:49.329170 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:49.330200 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:49.330952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:49.331419 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:49.331847 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:49.350361 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] HTTP exception thrown: Instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 could not be found. Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Request method failure captured: Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 HTTP/1.1 Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR71Fgj3TxYsyVzo2rqmkdlvt4iWnL5bfjcc0CFwuUIuDIDi04i8paFgZdOehgFnT33kxR3CDrn9DN52AxfMhZmF8nbwa-NxgPF4yZHXlB0BAER5JT3aPRXTbCuKy2NdJuBhu2bvdYlnjTgPq5jRFajcELOMSHC2yILZVGYgiDwXifk Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:49.352138 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}] Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 8640600ca0d745cda547a1027c947089 Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 could not be found. Aug 29 20:25:49.353579 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0'} Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 could not be found. Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:49.354867 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 could not be found. Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 could not be found. Aug 29 20:25:49.356288 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:49.357635 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Returning 404 to user: Instance f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:49.357635 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-11da4a8c-478f-4ef8-b647-10ce967b2a44 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0" status: 404 len: 111 microversion: 2.1 time: 0.040355 Aug 29 20:25:49.357635 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 582/1166] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:49 2022] GET /compute/v2.1/servers/f2e9734d-46c0-4fec-ba5d-d6ea8e6df7a0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:52.496089 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:52.496584 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:52.501970 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-90729b46-6e51-4a6e-87cb-4cf2949afa67 req-dcf4bbf7-3987-4ae0-accb-fee20bed5b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc668fb0-2df9-4f20-b2eb-edb014a2eb1c", "tag": "2fe84f3d-7bc6-4d1c-a981-074dce1683fd"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:52.506579 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.513116 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-90729b46-6e51-4a6e-87cb-4cf2949afa67 req-dcf4bbf7-3987-4ae0-accb-fee20bed5b0f service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.513591 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-90729b46-6e51-4a6e-87cb-4cf2949afa67 req-dcf4bbf7-3987-4ae0-accb-fee20bed5b0f service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.514039 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-90729b46-6e51-4a6e-87cb-4cf2949afa67 req-dcf4bbf7-3987-4ae0-accb-fee20bed5b0f service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:52.518554 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.518834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:52.519847 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.520306 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.520738 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:52.526952 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-90729b46-6e51-4a6e-87cb-4cf2949afa67 req-dcf4bbf7-3987-4ae0-accb-fee20bed5b0f service nova] Creating event network-changed:2fe84f3d-7bc6-4d1c-a981-074dce1683fd for instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c on hv-cinder-85426 Aug 29 20:25:52.531092 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-90729b46-6e51-4a6e-87cb-4cf2949afa67 req-dcf4bbf7-3987-4ae0-accb-fee20bed5b0f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032646 Aug 29 20:25:52.532060 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 583/1167] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:25:52.554011 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:25:52.670071 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-040dedaa-d808-4a88-b47a-2b30b1dbd7e3 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 204 len: 0 microversion: 2.1 time: 0.177658 Aug 29 20:25:52.670881 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 585/1168] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:52 2022] DELETE /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:25:52.680963 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:52.681820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:52.689271 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.689920 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.690450 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:52.691287 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.691843 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.692370 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:52.948420 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.policy [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120787) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:52.966062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-28c7f74e-70a9-4e0d-a4ed-30a122e61f35 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1577 microversion: 2.1 time: 0.283738 Aug 29 20:25:52.966062 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 584/1169] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:52 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1577 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:53.981736 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:53.982483 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:53.989160 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:53.989814 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:53.990210 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:53.991032 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:53.991493 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:53.991919 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:54.195523 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:54.208354 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-545d8ba4-d73f-4b2f-8969-af441cd5022f tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1577 microversion: 2.1 time: 0.230720 Aug 29 20:25:54.209861 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 586/1170] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:53 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1577 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:55.214547 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [req-248db100-4b11-4ce2-8d30-d860c85c7345 req-84feaf85-de39-4f3d-8661-0377044d4c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc668fb0-2df9-4f20-b2eb-edb014a2eb1c", "name": "network-vif-deleted", "tag": "2fe84f3d-7bc6-4d1c-a981-074dce1683fd"}]} {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:55.220439 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:55.227171 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-248db100-4b11-4ce2-8d30-d860c85c7345 req-84feaf85-de39-4f3d-8661-0377044d4c1c service nova] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:55.227634 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-248db100-4b11-4ce2-8d30-d860c85c7345 req-84feaf85-de39-4f3d-8661-0377044d4c1c service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:55.229629 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [req-248db100-4b11-4ce2-8d30-d860c85c7345 req-84feaf85-de39-4f3d-8661-0377044d4c1c service nova] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:55.244104 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.compute.server_external_events [req-248db100-4b11-4ce2-8d30-d860c85c7345 req-84feaf85-de39-4f3d-8661-0377044d4c1c service nova] Creating event network-vif-deleted:2fe84f3d-7bc6-4d1c-a981-074dce1683fd for instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c on hv-cinder-85426 Aug 29 20:25:55.248494 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:55.249497 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [req-248db100-4b11-4ce2-8d30-d860c85c7345 req-84feaf85-de39-4f3d-8661-0377044d4c1c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038479 Aug 29 20:25:55.249858 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:55.250067 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 585/1171] 10.222.0.73 () {64 vars in 1317 bytes} [Mon Aug 29 20:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:55.256229 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:55.263246 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:55.263746 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:55.264281 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:55.265206 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:55.265946 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:55.266471 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:55.270364 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:55.365819 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8640600ca0d745cda547a1027c947089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3969ffe8ff411b8773e1f3f3cb0b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:55.377673 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6c1186c0-edec-4296-bd91-a9990b8545f7 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 200 len: 1225 microversion: 2.1 time: 0.143446 Aug 29 20:25:55.378695 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 587/1172] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:55 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:56.401350 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:56.402553 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: bc668fb0-2df9-4f20-b2eb-edb014a2eb1c] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:56.409863 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:56.410460 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:56.410973 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:56.412014 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:56.412704 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:56.413210 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:56.417351 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG dbcounter [-] [120787] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:56.431953 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] HTTP exception thrown: Instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c could not be found. Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Request method failure captured: Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c HTTP/1.1 Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR71Fgj3TxYsyVzo2rqmkdlvt4iWnL5bfjcc0CFwuUIuDIDi04i8paFgZdOehgFnT33kxR3CDrn9DN52AxfMhZmF8nbwa-NxgPF4yZHXlB0BAER5JT3aPRXTbCuKy2NdJuBhu2bvdYlnjTgPq5jRFajcELOMSHC2yILZVGYgiDwXifk Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:56.434012 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}] Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 8640600ca0d745cda547a1027c947089 Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c could not be found. Aug 29 20:25:56.435820 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': 'bc668fb0-2df9-4f20-b2eb-edb014a2eb1c'} Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c could not be found. Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:56.436781 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c could not be found. Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c could not be found. Aug 29 20:25:56.439114 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.440770 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Returning 404 to user: Instance bc668fb0-2df9-4f20-b2eb-edb014a2eb1c could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:56.440770 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-4ce6b28a-80d3-437a-8169-5595ae7feb42 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c" status: 404 len: 111 microversion: 2.1 time: 0.039953 Aug 29 20:25:56.440770 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 586/1173] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:56 2022] GET /compute/v2.1/servers/bc668fb0-2df9-4f20-b2eb-edb014a2eb1c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:56.919638 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:56.920196 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:56.925989 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:56.926466 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:56.927431 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:56.928384 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:56.928836 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:56.929259 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:56.942507 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] HTTP exception thrown: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Request method failure captured: Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 HTTP/1.1 Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.73 Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjDR71Fgj3TxYsyVzo2rqmkdlvt4iWnL5bfjcc0CFwuUIuDIDi04i8paFgZdOehgFnT33kxR3CDrn9DN52AxfMhZmF8nbwa-NxgPF4yZHXlB0BAER5JT3aPRXTbCuKy2NdJuBhu2bvdYlnjTgPq5jRFajcELOMSHC2yILZVGYgiDwXifk Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Role: member,reader Aug 29 20:25:56.944841 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Roles: member,reader Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}] Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Id: 8640600ca0d745cda547a1027c947089 Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: method: > Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: exception: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.946567 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '9785564a-cd3d-4595-8af9-dbb8f45a4920'} Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:56.948096 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.949834 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.951489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Returning 404 to user: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:56.951489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b0d704b4-799b-4c06-b403-912c58ede14c tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 404 len: 111 microversion: 2.1 time: 0.031207 Aug 29 20:25:56.951489 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 588/1174] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 29 20:25:56 2022] DELETE /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:56.956093 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '>' {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:56.956683 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.compute.api [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] [instance: 9785564a-cd3d-4595-8af9-dbb8f45a4920] Fetching instance by UUID {{(pid=120787) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:56.963733 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:56.964211 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:56.964642 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:56.965324 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Acquiring lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:56.965792 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:56.966206 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG oslo_concurrency.lockutils [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Lock "87b86c2a-8fe9-4ea5-824e-801d166189f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:56.980485 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.wsgi [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] HTTP exception thrown: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Request method failure captured: Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: request: GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 HTTP/1.1 Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept: application/json Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Accept-Encoding: identity Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Connection: close Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Length: 0 Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Content-Type: application/json Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Host: 10.222.0.73 Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: Openstack-System-Scope: None Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: User-Agent: python-urllib3/1.26.12 Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Auth-Token: gAAAAABjDR71Fgj3TxYsyVzo2rqmkdlvt4iWnL5bfjcc0CFwuUIuDIDi04i8paFgZdOehgFnT33kxR3CDrn9DN52AxfMhZmF8nbwa-NxgPF4yZHXlB0BAER5JT3aPRXTbCuKy2NdJuBhu2bvdYlnjTgPq5jRFajcELOMSHC2yILZVGYgiDwXifk Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Id: None Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Domain-Name: None Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Identity-Status: Confirmed Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Is-Admin-Project: True Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Id: default Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Domain-Name: Default Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Project-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Role: member,reader Aug 29 20:25:56.982053 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Roles: member,reader Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ff3969ffe8ff411b8773e1f3f3cb0b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ff3969ffe8ff411b8773e1f3f3cb0b40"}]}] Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Id: ff3969ffe8ff411b8773e1f3f3cb0b40 Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1159013430 Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Id: default Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Domain-Name: Default Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Id: 8640600ca0d745cda547a1027c947089 Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: X-User-Name: tempest-TestVolumeBootPattern-1159013430-project Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: method: > Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: exception: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.983803 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: action_args: {'id': '9785564a-cd3d-4595-8af9-dbb8f45a4920'} Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: {{(pid=120787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:25:56.984775 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. Aug 29 20:25:56.986504 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: ERROR nova.api.openstack.wsgi Aug 29 20:25:56.988229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: DEBUG nova.api.openstack.wsgi [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Returning 404 to user: Instance 9785564a-cd3d-4595-8af9-dbb8f45a4920 could not be found. {{(pid=120787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:25:56.988229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: INFO nova.api.openstack.requestlog [None req-ce37cbd5-9db9-4424-a557-5cd664f1cd53 tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920" status: 404 len: 111 microversion: 2.1 time: 0.031654 Aug 29 20:25:56.988229 dv-cinder-854261-2-iscsi devstack@n-api.service[120787]: [pid: 120787|app: 0|req: 587/1175] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 29 20:25:56 2022] GET /compute/v2.1/servers/9785564a-cd3d-4595-8af9-dbb8f45a4920 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:25:58.320321 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d2affa60-66b7-45c0-8da7-ca34ffd3fd7a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] Calling method '.version_select at 0x7f15f9e5c040>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:58.341561 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d2affa60-66b7-45c0-8da7-ca34ffd3fd7a tempest-TestVolumeBootPattern-1159013430 tempest-TestVolumeBootPattern-1159013430-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-220491953" status: 202 len: 0 microversion: 2.1 time: 0.025740 Aug 29 20:25:58.342168 dv-cinder-854261-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 589/1176] 10.222.0.73 () {58 vars in 1260 bytes} [Mon Aug 29 20:25:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-220491953 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)